2026-02-18T03:08:16.297 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-18T03:08:16.313 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T03:08:16.397 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509 branch: 20.2.1_2.17.26-baseline_2 description: nvmeof/basic/{base/install centos_latest clusters/4-gateways-2-initiator conf/{disable-pool-app} workloads/nvmeof_initiator} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '54509' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: 20.2.1_2.17.26-baseline_2 ceph: conf: global: mon warn on pool no app: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - OSD_DOWN - OSD_HOST_DOWN - OSD_ROOT_DOWN - PG_DEGRADED - NVMEOF_SINGLE_GATEWAY - CEPHADM_FAILED_DAEMON sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed workunit: branch: 20.2.1_2.17.26-baseline_2 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - client.0 - - client.1 - - host.a - mon.a - mgr.x - osd.0 - client.2 - ceph.nvmeof.nvmeof.a - - host.b - mon.b - osd.1 - client.3 - ceph.nvmeof.nvmeof.b - - host.c - mon.c - osd.2 - client.4 - ceph.nvmeof.nvmeof.c - - host.d - osd.3 - client.5 - ceph.nvmeof.nvmeof.d seed: 7043 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed sleep_before_teardown: 0 subset: 111/120000 suite: nvmeof suite_branch: 20.2.1_2.17.26-baseline_2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed targets: trial031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOVRxesIuCTUWdnvc3x69wR+9PNFo609DhstHaZJY4zNRL537imDSt6dUAWE8eY2Dcs9/87WKO3/waaEF+K6BYg= trial078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFTWT9f02d3A5Sg1ctYJ9dvlkGKbt3VpKuHwq8BbY4cpCc6lY98fdvmJ703g9FERKfRZg6buWLuxRrM75b1Zmb0= trial097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFlKPJsqpN7eXHLkFC6m4X8Utds3WhfR8+cQYXgJDQZQLHBjxfz3LMuOM++qNE/mXPeXVC0jPEnxqF8bfjujEYk= trial114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCwPhKxxtRteyypCM3SWTfs9oFY3ggBeKrx4VM6eKtuqsa2ZpyGVeMYgB2sNk0TBWuOZCLy3HmHYnosEGF3bFPE= trial119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKveoscvGHNQNrTQxdVKLJqCmBkO0Q68xT65MyPFTrBTHY1QhgJtWiJVyeg6Xxk4XmcWWSTbD590rUD2ov7qP6o= trial194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFvRxTuDhTbiSB4owOj/rlHQtZUbpetzZORfEsHwZDdW6UUxoQS5J4SsWJXvpW7Y1HyiO1nkZoe7ni3WPU+QfP0= tasks: - install: extra_packages: - nvme-cli - cephadm: null - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch host ls - ceph orch device ls - ceph osd lspools - nvmeof: gateway_config: cli_image: quay.io/ceph/nvmeof-cli:devel namespaces_count: 20 subsystems_count: 3 gw_image: quay.io/ceph/nvmeof:devel installer: host.a rbd: image_name_prefix: myimage pool_name: mypool - cephadm.wait_for_service: service: nvmeof.mypool.mygroup0 - workunit: clients: client.0: - nvmeof/setup_subsystem.sh env: RBD_IMAGE_PREFIX: myimage RBD_POOL: mypool no_coverage_and_limits: true - workunit: clients: client.0: - nvmeof/basic_tests.sh - nvmeof/fio_test.sh --start_ns 1 --end_ns 30 --rbd_iostat client.1: - nvmeof/basic_tests.sh - nvmeof/fio_test.sh --start_ns 31 --end_ns 60 env: IOSTAT_INTERVAL: '10' RBD_POOL: mypool RUNTIME: '600' no_coverage_and_limits: true timeout: 30m teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_21:21:52 tube: trial use_shaman: true user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-18T03:08:16.397 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa; will attempt to use it 2026-02-18T03:08:16.398 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa/tasks 2026-02-18T03:08:16.398 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-18T03:08:16.399 INFO:teuthology.task.internal:Checking packages... 2026-02-18T03:08:16.399 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'adc1923395f2bcd6ae89b5d331d278364d1848ed' 2026-02-18T03:08:16.399 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T03:08:16.399 INFO:teuthology.packaging:ref: None 2026-02-18T03:08:16.399 INFO:teuthology.packaging:tag: None 2026-02-18T03:08:16.399 INFO:teuthology.packaging:branch: 20.2.1_2.17.26-baseline_2 2026-02-18T03:08:16.399 INFO:teuthology.packaging:sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:08:16.400 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=20.2.1_2.17.26-baseline_2 2026-02-18T03:08:16.517 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-670.gadc19233 2026-02-18T03:08:16.518 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-18T03:08:16.529 INFO:teuthology.task.internal:no buildpackages task found 2026-02-18T03:08:16.529 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-18T03:08:16.544 INFO:teuthology.task.internal:Saving configuration 2026-02-18T03:08:16.553 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-18T03:08:16.564 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-18T03:08:16.633 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial031.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:04:42.714604', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOVRxesIuCTUWdnvc3x69wR+9PNFo609DhstHaZJY4zNRL537imDSt6dUAWE8eY2Dcs9/87WKO3/waaEF+K6BYg='} 2026-02-18T03:08:16.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial078.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:04:42.715223', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFTWT9f02d3A5Sg1ctYJ9dvlkGKbt3VpKuHwq8BbY4cpCc6lY98fdvmJ703g9FERKfRZg6buWLuxRrM75b1Zmb0='} 2026-02-18T03:08:16.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial097.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:04:42.714921', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFlKPJsqpN7eXHLkFC6m4X8Utds3WhfR8+cQYXgJDQZQLHBjxfz3LMuOM++qNE/mXPeXVC0jPEnxqF8bfjujEYk='} 2026-02-18T03:08:16.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial114.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:04:42.713930', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCwPhKxxtRteyypCM3SWTfs9oFY3ggBeKrx4VM6eKtuqsa2ZpyGVeMYgB2sNk0TBWuOZCLy3HmHYnosEGF3bFPE='} 2026-02-18T03:08:16.859 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial119.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:04:42.713218', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKveoscvGHNQNrTQxdVKLJqCmBkO0Q68xT65MyPFTrBTHY1QhgJtWiJVyeg6Xxk4XmcWWSTbD590rUD2ov7qP6o='} 2026-02-18T03:08:16.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial194.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:04:42.714272', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFvRxTuDhTbiSB4owOj/rlHQtZUbpetzZORfEsHwZDdW6UUxoQS5J4SsWJXvpW7Y1HyiO1nkZoe7ni3WPU+QfP0='} 2026-02-18T03:08:16.914 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-18T03:08:16.926 INFO:teuthology.task.internal:roles: ubuntu@trial031.front.sepia.ceph.com - ['client.0'] 2026-02-18T03:08:16.926 INFO:teuthology.task.internal:roles: ubuntu@trial078.front.sepia.ceph.com - ['client.1'] 2026-02-18T03:08:16.926 INFO:teuthology.task.internal:roles: ubuntu@trial097.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.x', 'osd.0', 'client.2', 'ceph.nvmeof.nvmeof.a'] 2026-02-18T03:08:16.926 INFO:teuthology.task.internal:roles: ubuntu@trial114.front.sepia.ceph.com - ['host.b', 'mon.b', 'osd.1', 'client.3', 'ceph.nvmeof.nvmeof.b'] 2026-02-18T03:08:16.926 INFO:teuthology.task.internal:roles: ubuntu@trial119.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.2', 'client.4', 'ceph.nvmeof.nvmeof.c'] 2026-02-18T03:08:16.926 INFO:teuthology.task.internal:roles: ubuntu@trial194.front.sepia.ceph.com - ['host.d', 'osd.3', 'client.5', 'ceph.nvmeof.nvmeof.d'] 2026-02-18T03:08:16.926 INFO:teuthology.run_tasks:Running task console_log... 2026-02-18T03:08:17.287 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76ebccf3ec00>, signals=[15]) 2026-02-18T03:08:17.287 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-18T03:08:17.300 INFO:teuthology.task.internal:Opening connections... 2026-02-18T03:08:17.300 DEBUG:teuthology.task.internal:connecting to ubuntu@trial031.front.sepia.ceph.com 2026-02-18T03:08:17.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:08:17.363 DEBUG:teuthology.task.internal:connecting to ubuntu@trial078.front.sepia.ceph.com 2026-02-18T03:08:17.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:08:17.422 DEBUG:teuthology.task.internal:connecting to ubuntu@trial097.front.sepia.ceph.com 2026-02-18T03:08:17.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:08:17.485 DEBUG:teuthology.task.internal:connecting to ubuntu@trial114.front.sepia.ceph.com 2026-02-18T03:08:17.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:08:17.547 DEBUG:teuthology.task.internal:connecting to ubuntu@trial119.front.sepia.ceph.com 2026-02-18T03:08:17.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:08:17.609 DEBUG:teuthology.task.internal:connecting to ubuntu@trial194.front.sepia.ceph.com 2026-02-18T03:08:17.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:08:17.668 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-18T03:08:17.681 DEBUG:teuthology.orchestra.run.trial031:> uname -m 2026-02-18T03:08:17.697 INFO:teuthology.orchestra.run.trial031.stdout:x86_64 2026-02-18T03:08:17.698 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:NAME="CentOS Stream" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="9" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:ID="centos" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="9" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;31" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:08:17.753 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:08:17.754 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server 2026-02-18T03:08:17.823 DEBUG:teuthology.orchestra.run.trial078:> uname -m 2026-02-18T03:08:17.838 INFO:teuthology.orchestra.run.trial078.stdout:x86_64 2026-02-18T03:08:17.838 DEBUG:teuthology.orchestra.run.trial078:> cat /etc/os-release 2026-02-18T03:08:17.893 INFO:teuthology.orchestra.run.trial078.stdout:NAME="CentOS Stream" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:VERSION="9" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:ID="centos" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:VERSION_ID="9" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:ANSI_COLOR="0;31" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:08:17.894 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:08:17.894 INFO:teuthology.lock.ops:Updating trial078.front.sepia.ceph.com on lock server 2026-02-18T03:08:17.970 DEBUG:teuthology.orchestra.run.trial097:> uname -m 2026-02-18T03:08:17.987 INFO:teuthology.orchestra.run.trial097.stdout:x86_64 2026-02-18T03:08:17.987 DEBUG:teuthology.orchestra.run.trial097:> cat /etc/os-release 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:NAME="CentOS Stream" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:VERSION="9" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:ID="centos" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:VERSION_ID="9" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:ANSI_COLOR="0;31" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:08:18.042 INFO:teuthology.orchestra.run.trial097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:08:18.043 INFO:teuthology.lock.ops:Updating trial097.front.sepia.ceph.com on lock server 2026-02-18T03:08:18.124 DEBUG:teuthology.orchestra.run.trial114:> uname -m 2026-02-18T03:08:18.140 INFO:teuthology.orchestra.run.trial114.stdout:x86_64 2026-02-18T03:08:18.140 DEBUG:teuthology.orchestra.run.trial114:> cat /etc/os-release 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:NAME="CentOS Stream" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:VERSION="9" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:ID="centos" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:VERSION_ID="9" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:ANSI_COLOR="0;31" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:08:18.196 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:08:18.197 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:08:18.197 INFO:teuthology.lock.ops:Updating trial114.front.sepia.ceph.com on lock server 2026-02-18T03:08:18.280 DEBUG:teuthology.orchestra.run.trial119:> uname -m 2026-02-18T03:08:18.295 INFO:teuthology.orchestra.run.trial119.stdout:x86_64 2026-02-18T03:08:18.296 DEBUG:teuthology.orchestra.run.trial119:> cat /etc/os-release 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:NAME="CentOS Stream" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:VERSION="9" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:ID="centos" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_ID="9" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:ANSI_COLOR="0;31" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:08:18.351 INFO:teuthology.orchestra.run.trial119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:08:18.352 INFO:teuthology.orchestra.run.trial119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:08:18.352 INFO:teuthology.orchestra.run.trial119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:08:18.352 INFO:teuthology.lock.ops:Updating trial119.front.sepia.ceph.com on lock server 2026-02-18T03:08:18.430 DEBUG:teuthology.orchestra.run.trial194:> uname -m 2026-02-18T03:08:18.445 INFO:teuthology.orchestra.run.trial194.stdout:x86_64 2026-02-18T03:08:18.445 DEBUG:teuthology.orchestra.run.trial194:> cat /etc/os-release 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:NAME="CentOS Stream" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:VERSION="9" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:ID="centos" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:VERSION_ID="9" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:ANSI_COLOR="0;31" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:08:18.501 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:08:18.502 INFO:teuthology.lock.ops:Updating trial194.front.sepia.ceph.com on lock server 2026-02-18T03:08:18.582 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-18T03:08:18.595 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-18T03:08:18.607 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-18T03:08:18.607 DEBUG:teuthology.orchestra.run.trial031:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:08:18.609 DEBUG:teuthology.orchestra.run.trial078:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:08:18.610 DEBUG:teuthology.orchestra.run.trial097:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:08:18.612 DEBUG:teuthology.orchestra.run.trial114:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:08:18.613 DEBUG:teuthology.orchestra.run.trial119:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:08:18.615 DEBUG:teuthology.orchestra.run.trial194:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:08:18.632 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-18T03:08:18.643 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-18T03:08:18.643 DEBUG:teuthology.orchestra.run.trial031:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:08:18.664 DEBUG:teuthology.orchestra.run.trial078:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:08:18.666 DEBUG:teuthology.orchestra.run.trial097:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:08:18.668 DEBUG:teuthology.orchestra.run.trial114:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:08:18.670 DEBUG:teuthology.orchestra.run.trial119:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:08:18.672 DEBUG:teuthology.orchestra.run.trial194:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:08:18.689 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-18T03:08:19.071 INFO:teuthology.run_tasks:Running task kernel... 2026-02-18T03:08:19.091 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-18T03:08:19.091 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'client.1': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.c': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.d': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-18T03:08:19.092 DEBUG:teuthology.orchestra.run.trial031:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:08:19.092 DEBUG:teuthology.orchestra.run.trial078:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:08:19.092 DEBUG:teuthology.orchestra.run.trial097:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:08:19.092 DEBUG:teuthology.orchestra.run.trial114:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:08:19.092 DEBUG:teuthology.orchestra.run.trial119:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:08:19.092 DEBUG:teuthology.orchestra.run.trial194:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:08:19.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:08:19.107 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-18T03:08:19.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:08:19.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:08:19.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:08:19.108 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-18T03:08:19.108 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-18T03:08:19.108 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-18T03:08:19.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:08:19.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:08:19.108 DEBUG:teuthology.orchestra.run.trial097:> uname -r 2026-02-18T03:08:19.109 DEBUG:teuthology.orchestra.run.trial194:> uname -r 2026-02-18T03:08:19.162 INFO:teuthology.orchestra.run.trial114.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:08:19.162 INFO:teuthology.task.kernel:Running kernel on trial114: 5.14.0-645.el9.x86_64 2026-02-18T03:08:19.162 DEBUG:teuthology.orchestra.run.trial114:> sudo yum install -y kernel 2026-02-18T03:08:19.163 INFO:teuthology.orchestra.run.trial031.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:08:19.163 INFO:teuthology.task.kernel:Running kernel on trial031: 5.14.0-645.el9.x86_64 2026-02-18T03:08:19.163 DEBUG:teuthology.orchestra.run.trial031:> sudo yum install -y kernel 2026-02-18T03:08:19.163 INFO:teuthology.orchestra.run.trial097.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:08:19.163 INFO:teuthology.orchestra.run.trial119.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:08:19.164 INFO:teuthology.task.kernel:Running kernel on trial097: 5.14.0-645.el9.x86_64 2026-02-18T03:08:19.164 DEBUG:teuthology.orchestra.run.trial097:> sudo yum install -y kernel 2026-02-18T03:08:19.164 INFO:teuthology.task.kernel:Running kernel on trial119: 5.14.0-645.el9.x86_64 2026-02-18T03:08:19.164 DEBUG:teuthology.orchestra.run.trial119:> sudo yum install -y kernel 2026-02-18T03:08:19.164 INFO:teuthology.orchestra.run.trial078.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:08:19.164 INFO:teuthology.task.kernel:Running kernel on trial078: 5.14.0-645.el9.x86_64 2026-02-18T03:08:19.164 DEBUG:teuthology.orchestra.run.trial078:> sudo yum install -y kernel 2026-02-18T03:08:19.165 INFO:teuthology.orchestra.run.trial194.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:08:19.165 INFO:teuthology.task.kernel:Running kernel on trial194: 5.14.0-645.el9.x86_64 2026-02-18T03:08:19.165 DEBUG:teuthology.orchestra.run.trial194:> sudo yum install -y kernel 2026-02-18T03:08:20.115 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.9 MB 00:00 2026-02-18T03:08:20.216 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-18T03:08:20.638 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 8.9 MB 00:01 2026-02-18T03:08:21.002 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.9 MB 00:01 2026-02-18T03:08:21.168 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.9 MB 00:01 2026-02-18T03:08:21.284 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.9 MB 00:01 2026-02-18T03:08:22.815 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-18T03:08:23.397 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 27 MB 00:02 2026-02-18T03:08:23.841 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-18T03:08:24.346 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-18T03:08:24.934 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 27 MB 00:03 2026-02-18T03:08:25.347 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - AppStream 7.3 MB/s | 27 MB 00:03 2026-02-18T03:08:26.328 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 7.8 MB 00:01 2026-02-18T03:08:26.621 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - CRB 24 MB/s | 7.8 MB 00:00 2026-02-18T03:08:27.411 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 20 kB 00:00 2026-02-18T03:08:27.815 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 7.8 MB 00:01 2026-02-18T03:08:28.155 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 7.8 MB 00:01 2026-02-18T03:08:28.350 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-18T03:08:28.476 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-18T03:08:29.051 INFO:teuthology.orchestra.run.trial119.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-18T03:08:29.343 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 20 kB 00:00 2026-02-18T03:08:29.434 INFO:teuthology.orchestra.run.trial097.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-18T03:08:29.591 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 7.8 MB 00:01 2026-02-18T03:08:29.652 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-18T03:08:29.935 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-18T03:08:30.231 INFO:teuthology.orchestra.run.trial031.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-18T03:08:30.260 INFO:teuthology.orchestra.run.trial114.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-18T03:08:31.316 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-18T03:08:31.531 INFO:teuthology.orchestra.run.trial194.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-18T03:08:31.876 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 41 MB/s | 20 MB 00:00 2026-02-18T03:08:32.268 INFO:teuthology.orchestra.run.trial119.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-18T03:08:32.755 INFO:teuthology.orchestra.run.trial097.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:08:33.282 INFO:teuthology.orchestra.run.trial119.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:08:33.304 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:08:33.305 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:08:33.305 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-18T03:08:33.305 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:08:33.305 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout:Install 4 Packages 2026-02-18T03:08:33.306 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:08:33.307 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 88 M 2026-02-18T03:08:33.307 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 135 M 2026-02-18T03:08:33.307 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:08:33.454 INFO:teuthology.orchestra.run.trial031.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-18T03:08:33.456 INFO:teuthology.orchestra.run.trial114.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:08:33.770 INFO:teuthology.orchestra.run.trial097.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:08:33.791 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:08:33.793 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:08:33.794 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:08:33.794 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:08:33.794 INFO:teuthology.orchestra.run.trial097.stdout:Install 4 Packages 2026-02-18T03:08:33.794 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:08:33.794 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 88 M 2026-02-18T03:08:33.794 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 135 M 2026-02-18T03:08:33.794 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:08:33.882 INFO:teuthology.orchestra.run.trial097.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 25 MB/s | 803 kB 00:00 2026-02-18T03:08:33.958 INFO:teuthology.orchestra.run.trial097.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 160 MB/s | 17 MB 00:00 2026-02-18T03:08:34.028 INFO:teuthology.orchestra.run.trial097.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 212 MB/s | 31 MB 00:00 2026-02-18T03:08:34.087 INFO:teuthology.orchestra.run.trial097.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 168 MB/s | 40 MB 00:00 2026-02-18T03:08:34.087 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:08:34.088 INFO:teuthology.orchestra.run.trial097.stdout:Total 300 MB/s | 88 MB 00:00 2026-02-18T03:08:34.278 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:08:34.460 INFO:teuthology.orchestra.run.trial031.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:08:34.466 INFO:teuthology.orchestra.run.trial114.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:08:34.480 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:08:34.480 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:08:34.481 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:08:34.483 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:08:34.484 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:08:34.484 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:08:34.484 INFO:teuthology.orchestra.run.trial031.stdout:Install 4 Packages 2026-02-18T03:08:34.484 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:08:34.484 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 88 M 2026-02-18T03:08:34.484 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 135 M 2026-02-18T03:08:34.484 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:08:34.488 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:08:34.489 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:08:34.489 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-18T03:08:34.489 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:08:34.490 INFO:teuthology.orchestra.run.trial114.stdout:Install 4 Packages 2026-02-18T03:08:34.491 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:08:34.491 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 88 M 2026-02-18T03:08:34.491 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 135 M 2026-02-18T03:08:34.491 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:08:34.675 INFO:teuthology.orchestra.run.trial194.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-18T03:08:34.688 INFO:teuthology.orchestra.run.trial119.stdout:(1/4): kernel-core-5.14.0-681.el9.x86_64.rpm 13 MB/s | 17 MB 00:01 2026-02-18T03:08:34.749 INFO:teuthology.orchestra.run.trial114.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 4.6 MB/s | 803 kB 00:00 2026-02-18T03:08:34.828 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:08:34.828 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:08:34.929 INFO:teuthology.orchestra.run.trial114.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 49 MB/s | 17 MB 00:00 2026-02-18T03:08:35.087 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:08:35.448 INFO:teuthology.orchestra.run.trial119.stdout:(2/4): kernel-modules-core-5.14.0-681.el9.x86_6 41 MB/s | 31 MB 00:00 2026-02-18T03:08:35.661 INFO:teuthology.orchestra.run.trial031.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 921 kB/s | 803 kB 00:00 2026-02-18T03:08:35.699 INFO:teuthology.orchestra.run.trial194.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:08:35.721 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:08:35.722 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:08:35.722 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-18T03:08:35.722 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout:Install 4 Packages 2026-02-18T03:08:35.723 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:08:35.724 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 88 M 2026-02-18T03:08:35.724 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 135 M 2026-02-18T03:08:35.724 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:08:35.751 INFO:teuthology.orchestra.run.trial114.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 31 MB/s | 31 MB 00:01 2026-02-18T03:08:35.824 INFO:teuthology.orchestra.run.trial114.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 32 MB/s | 40 MB 00:01 2026-02-18T03:08:35.824 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:08:35.825 INFO:teuthology.orchestra.run.trial114.stdout:Total 66 MB/s | 88 MB 00:01 2026-02-18T03:08:35.916 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:08:36.017 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:08:36.112 INFO:teuthology.orchestra.run.trial078.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:08:36.134 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:08:36.135 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:08:36.135 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:08:36.136 INFO:teuthology.orchestra.run.trial078.stdout:Install 4 Packages 2026-02-18T03:08:36.137 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:08:36.137 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 88 M 2026-02-18T03:08:36.137 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 135 M 2026-02-18T03:08:36.137 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:08:36.196 INFO:teuthology.orchestra.run.trial097.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:08:36.215 INFO:teuthology.orchestra.run.trial097.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:36.219 INFO:teuthology.orchestra.run.trial031.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 12 MB/s | 17 MB 00:01 2026-02-18T03:08:36.223 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:08:36.223 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:08:36.333 INFO:teuthology.orchestra.run.trial078.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 5.7 MB/s | 803 kB 00:00 2026-02-18T03:08:36.533 INFO:teuthology.orchestra.run.trial078.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 51 MB/s | 17 MB 00:00 2026-02-18T03:08:36.569 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:08:36.569 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:08:36.641 INFO:teuthology.orchestra.run.trial078.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 100 MB/s | 31 MB 00:00 2026-02-18T03:08:36.679 INFO:teuthology.orchestra.run.trial194.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 919 kB/s | 803 kB 00:00 2026-02-18T03:08:36.775 INFO:teuthology.orchestra.run.trial078.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 69 MB/s | 40 MB 00:00 2026-02-18T03:08:36.775 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:08:36.775 INFO:teuthology.orchestra.run.trial078.stdout:Total 138 MB/s | 88 MB 00:00 2026-02-18T03:08:36.793 INFO:teuthology.orchestra.run.trial031.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 27 MB/s | 31 MB 00:01 2026-02-18T03:08:36.966 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:08:37.166 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:08:37.166 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:08:37.298 INFO:teuthology.orchestra.run.trial194.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 11 MB/s | 17 MB 00:01 2026-02-18T03:08:37.513 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:08:37.513 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:08:37.663 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:08:37.830 INFO:teuthology.orchestra.run.trial194.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 20 MB/s | 40 MB 00:02 2026-02-18T03:08:37.949 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:08:37.956 INFO:teuthology.orchestra.run.trial194.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 24 MB/s | 31 MB 00:01 2026-02-18T03:08:37.958 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:08:37.958 INFO:teuthology.orchestra.run.trial194.stdout:Total 39 MB/s | 88 MB 00:02 2026-02-18T03:08:37.967 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:38.007 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:38.034 INFO:teuthology.orchestra.run.trial097.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:38.152 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:08:38.356 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:08:38.356 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:08:38.543 INFO:teuthology.orchestra.run.trial031.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 11 MB/s | 40 MB 00:03 2026-02-18T03:08:38.545 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:08:38.545 INFO:teuthology.orchestra.run.trial031.stdout:Total 22 MB/s | 88 MB 00:04 2026-02-18T03:08:38.596 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:08:38.704 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:08:38.704 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:08:38.736 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:08:38.875 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:08:38.894 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:38.933 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:08:38.934 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:08:39.237 INFO:teuthology.orchestra.run.trial119.stdout:(3/4): kernel-5.14.0-681.el9.x86_64.rpm 137 kB/s | 803 kB 00:05 2026-02-18T03:08:39.280 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:08:39.281 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:08:39.748 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:39.777 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:39.793 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:08:40.078 INFO:teuthology.orchestra.run.trial194.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:08:40.097 INFO:teuthology.orchestra.run.trial194.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:40.357 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:08:40.637 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:08:40.656 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:40.680 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:40.709 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:41.248 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:41.254 INFO:teuthology.orchestra.run.trial097.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:41.296 INFO:teuthology.orchestra.run.trial119.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 5.0 MB/s | 40 MB 00:07 2026-02-18T03:08:41.298 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:08:41.298 INFO:teuthology.orchestra.run.trial119.stdout:Total 11 MB/s | 88 MB 00:07 2026-02-18T03:08:41.491 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:08:41.694 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:08:41.694 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:08:41.874 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:41.902 INFO:teuthology.orchestra.run.trial194.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:42.039 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:08:42.040 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:08:42.438 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:42.467 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:42.867 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:42.874 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:43.127 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:08:43.410 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:08:43.429 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:43.731 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:43.737 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:44.288 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:44.987 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:44.993 INFO:teuthology.orchestra.run.trial194.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:45.209 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:08:45.238 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:45.555 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:45.561 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:45.907 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:46.988 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:48.032 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:48.321 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:08:48.327 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:48.804 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:08:51.554 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:14.718 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:14.740 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:14.909 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:14.909 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:09:14.909 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:09:14.909 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:09:14.960 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:14.960 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:09:14.960 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:09:14.961 INFO:teuthology.orchestra.run.trial097.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:14.961 INFO:teuthology.orchestra.run.trial097.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:14.961 INFO:teuthology.orchestra.run.trial097.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:09:14.961 INFO:teuthology.orchestra.run.trial097.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:14.961 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:09:14.961 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:09:15.019 DEBUG:teuthology.orchestra.run.trial097:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:15.045 INFO:teuthology.orchestra.run.trial097.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:15.046 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:15.046 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:09:15.047 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:09:15.047 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:09:15.047 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-18T03:09:15.047 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial097.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:09:15.047 DEBUG:teuthology.orchestra.run.trial097:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:15.109 INFO:teuthology.orchestra.run.trial097.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:15.110 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:15.110 DEBUG:teuthology.orchestra.run.trial097:> sudo rpm -qi grub2-tools 2026-02-18T03:09:15.177 INFO:teuthology.orchestra.run.trial097.stdout:Name : grub2-tools 2026-02-18T03:09:15.178 INFO:teuthology.orchestra.run.trial097.stdout:Epoch : 1 2026-02-18T03:09:15.178 INFO:teuthology.orchestra.run.trial097.stdout:Version : 2.06 2026-02-18T03:09:15.178 INFO:teuthology.orchestra.run.trial097.stdout:Release : 118.el9 2026-02-18T03:09:15.178 INFO:teuthology.orchestra.run.trial097.stdout:Architecture: x86_64 2026-02-18T03:09:15.178 INFO:teuthology.orchestra.run.trial097.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:09:15.178 INFO:teuthology.orchestra.run.trial097.stdout:Group : Unspecified 2026-02-18T03:09:15.178 INFO:teuthology.orchestra.run.trial097.stdout:Size : 8393909 2026-02-18T03:09:15.178 INFO:teuthology.orchestra.run.trial097.stdout:License : GPLv3+ 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:Packager : builder@centos.org 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:Vendor : CentOS 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:Summary : Support tools for GRUB. 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:Description : 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:09:15.179 INFO:teuthology.orchestra.run.trial097.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:09:15.180 INFO:teuthology.orchestra.run.trial097.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:09:15.180 INFO:teuthology.orchestra.run.trial097.stdout:hardware devices. 2026-02-18T03:09:15.180 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:09:15.180 INFO:teuthology.orchestra.run.trial097.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:09:15.181 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:09:15.181 INFO:teuthology.task.kernel:Updating grub on trial097 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:09:15.181 DEBUG:teuthology.orchestra.run.trial097:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:09:15.244 INFO:teuthology.orchestra.run.trial097.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:15.245 DEBUG:teuthology.orchestra.run.trial097:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:09:15.309 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/grubby 2026-02-18T03:09:15.311 INFO:teuthology.orchestra.run.trial097.stdout:yes 2026-02-18T03:09:15.311 DEBUG:teuthology.orchestra.run.trial097:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:09:15.375 INFO:teuthology.orchestra.run.trial097.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:15.376 DEBUG:teuthology.orchestra.run.trial097:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:09:15.451 DEBUG:teuthology.orchestra.run.trial097:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:09:15.663 INFO:teuthology.orchestra.run.trial097.stderr:Generating grub configuration file ... 2026-02-18T03:09:15.726 INFO:teuthology.orchestra.run.trial097.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:09:15.732 INFO:teuthology.orchestra.run.trial097.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:09:15.986 INFO:teuthology.orchestra.run.trial097.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:09:15.992 INFO:teuthology.orchestra.run.trial097.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:09:16.024 INFO:teuthology.orchestra.run.trial097.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:09:16.031 INFO:teuthology.orchestra.run.trial097.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:09:16.054 INFO:teuthology.orchestra.run.trial097.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:09:16.061 INFO:teuthology.orchestra.run.trial097.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:09:16.142 INFO:teuthology.orchestra.run.trial097.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:09:16.150 INFO:teuthology.orchestra.run.trial097.stderr:done 2026-02-18T03:09:16.152 DEBUG:teuthology.orchestra.run.trial097:> test -d /sys/firmware/efi 2026-02-18T03:09:16.168 DEBUG:teuthology.orchestra.run.trial097:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:09:16.232 INFO:teuthology.orchestra.run.trial097.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:09:16.232 INFO:teuthology.orchestra.run.trial097.stdout:/boot/efi/EFI/centos 2026-02-18T03:09:16.234 DEBUG:teuthology.orchestra.run.trial097:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:09:16.242 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:16.264 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:16.298 INFO:teuthology.orchestra.run.trial097.stdout:no 2026-02-18T03:09:16.299 DEBUG:teuthology.orchestra.run.trial097:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:09:16.328 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:16.328 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:09:16.329 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:09:16.329 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:09:16.363 INFO:teuthology.orchestra.run.trial097.stdout:yes 2026-02-18T03:09:16.364 DEBUG:teuthology.orchestra.run.trial097:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:09:16.380 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:16.381 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:09:16.381 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:09:16.381 INFO:teuthology.orchestra.run.trial114.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:16.381 INFO:teuthology.orchestra.run.trial114.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:16.381 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:09:16.381 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:16.381 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:09:16.381 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:09:16.428 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial097 2026-02-18T03:09:16.428 DEBUG:teuthology.orchestra.run.trial097:> sudo bash -c ' 2026-02-18T03:09:16.428 DEBUG:teuthology.orchestra.run.trial097:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:09:16.428 DEBUG:teuthology.orchestra.run.trial097:> ' 2026-02-18T03:09:16.438 DEBUG:teuthology.orchestra.run.trial114:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:16.463 INFO:teuthology.orchestra.run.trial114.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:16.465 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:16.465 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:09:16.465 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:09:16.465 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:09:16.465 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-18T03:09:16.465 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial114.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:09:16.465 DEBUG:teuthology.orchestra.run.trial114:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:16.526 INFO:teuthology.orchestra.run.trial114.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:16.528 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:16.528 DEBUG:teuthology.orchestra.run.trial114:> sudo rpm -qi grub2-tools 2026-02-18T03:09:16.599 INFO:teuthology.orchestra.run.trial114.stdout:Name : grub2-tools 2026-02-18T03:09:16.599 INFO:teuthology.orchestra.run.trial114.stdout:Epoch : 1 2026-02-18T03:09:16.599 INFO:teuthology.orchestra.run.trial114.stdout:Version : 2.06 2026-02-18T03:09:16.599 INFO:teuthology.orchestra.run.trial114.stdout:Release : 118.el9 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Architecture: x86_64 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Group : Unspecified 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Size : 8393909 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:License : GPLv3+ 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Packager : builder@centos.org 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Vendor : CentOS 2026-02-18T03:09:16.600 INFO:teuthology.orchestra.run.trial114.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout:Summary : Support tools for GRUB. 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout:Description : 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout:hardware devices. 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:09:16.601 INFO:teuthology.orchestra.run.trial114.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:09:16.602 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:09:16.602 INFO:teuthology.task.kernel:Updating grub on trial114 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:09:16.603 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:09:16.667 INFO:teuthology.orchestra.run.trial114.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:16.668 DEBUG:teuthology.orchestra.run.trial114:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:09:16.731 INFO:teuthology.orchestra.run.trial114.stdout:/sbin/grubby 2026-02-18T03:09:16.733 INFO:teuthology.orchestra.run.trial114.stdout:yes 2026-02-18T03:09:16.733 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:09:16.798 INFO:teuthology.orchestra.run.trial114.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:16.799 DEBUG:teuthology.orchestra.run.trial114:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:09:16.873 DEBUG:teuthology.orchestra.run.trial114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:09:17.081 INFO:teuthology.orchestra.run.trial114.stderr:Generating grub configuration file ... 2026-02-18T03:09:17.144 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:09:17.151 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:09:17.341 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:17.363 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:17.398 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:09:17.405 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:09:17.427 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:17.427 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:09:17.427 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:09:17.427 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:09:17.436 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:09:17.443 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:09:17.466 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:09:17.473 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:09:17.478 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:17.478 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:09:17.479 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:09:17.479 INFO:teuthology.orchestra.run.trial078.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:17.479 INFO:teuthology.orchestra.run.trial078.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:17.479 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:09:17.479 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:17.479 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:09:17.479 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:09:17.537 DEBUG:teuthology.orchestra.run.trial078:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:17.556 INFO:teuthology.orchestra.run.trial114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:09:17.562 INFO:teuthology.orchestra.run.trial078.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:17.562 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:17.562 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:09:17.562 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:09:17.562 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:09:17.562 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2026-02-18T03:09:17.562 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial078.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:09:17.562 DEBUG:teuthology.orchestra.run.trial078:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:17.565 INFO:teuthology.orchestra.run.trial114.stderr:done 2026-02-18T03:09:17.567 DEBUG:teuthology.orchestra.run.trial114:> test -d /sys/firmware/efi 2026-02-18T03:09:17.582 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:09:17.624 INFO:teuthology.orchestra.run.trial078.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:17.624 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:17.625 DEBUG:teuthology.orchestra.run.trial078:> sudo rpm -qi grub2-tools 2026-02-18T03:09:17.646 INFO:teuthology.orchestra.run.trial114.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:09:17.646 INFO:teuthology.orchestra.run.trial114.stdout:/boot/efi/EFI/centos 2026-02-18T03:09:17.649 DEBUG:teuthology.orchestra.run.trial114:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:09:17.694 INFO:teuthology.orchestra.run.trial078.stdout:Name : grub2-tools 2026-02-18T03:09:17.694 INFO:teuthology.orchestra.run.trial078.stdout:Epoch : 1 2026-02-18T03:09:17.694 INFO:teuthology.orchestra.run.trial078.stdout:Version : 2.06 2026-02-18T03:09:17.694 INFO:teuthology.orchestra.run.trial078.stdout:Release : 118.el9 2026-02-18T03:09:17.694 INFO:teuthology.orchestra.run.trial078.stdout:Architecture: x86_64 2026-02-18T03:09:17.694 INFO:teuthology.orchestra.run.trial078.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Group : Unspecified 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Size : 8393909 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:License : GPLv3+ 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Packager : builder@centos.org 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Vendor : CentOS 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Summary : Support tools for GRUB. 2026-02-18T03:09:17.695 INFO:teuthology.orchestra.run.trial078.stdout:Description : 2026-02-18T03:09:17.696 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:09:17.696 INFO:teuthology.orchestra.run.trial078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:09:17.696 INFO:teuthology.orchestra.run.trial078.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:09:17.696 INFO:teuthology.orchestra.run.trial078.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:09:17.696 INFO:teuthology.orchestra.run.trial078.stdout:hardware devices. 2026-02-18T03:09:17.696 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:09:17.696 INFO:teuthology.orchestra.run.trial078.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:09:17.697 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:09:17.697 INFO:teuthology.task.kernel:Updating grub on trial078 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:09:17.697 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:09:17.714 INFO:teuthology.orchestra.run.trial114.stdout:no 2026-02-18T03:09:17.715 DEBUG:teuthology.orchestra.run.trial114:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:09:17.760 INFO:teuthology.orchestra.run.trial078.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:17.762 DEBUG:teuthology.orchestra.run.trial078:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:09:17.778 INFO:teuthology.orchestra.run.trial114.stdout:yes 2026-02-18T03:09:17.779 DEBUG:teuthology.orchestra.run.trial114:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:09:17.826 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/grubby 2026-02-18T03:09:17.827 INFO:teuthology.orchestra.run.trial078.stdout:yes 2026-02-18T03:09:17.827 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:09:17.842 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial114 2026-02-18T03:09:17.842 DEBUG:teuthology.orchestra.run.trial114:> sudo bash -c ' 2026-02-18T03:09:17.842 DEBUG:teuthology.orchestra.run.trial114:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:09:17.842 DEBUG:teuthology.orchestra.run.trial114:> ' 2026-02-18T03:09:17.891 INFO:teuthology.orchestra.run.trial078.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:17.891 DEBUG:teuthology.orchestra.run.trial078:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:09:17.964 DEBUG:teuthology.orchestra.run.trial078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:09:18.170 INFO:teuthology.orchestra.run.trial078.stderr:Generating grub configuration file ... 2026-02-18T03:09:18.231 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:09:18.237 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:09:18.301 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:18.322 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:18.386 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:18.386 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:09:18.386 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:09:18.386 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:09:18.439 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:18.439 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:09:18.439 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:09:18.439 INFO:teuthology.orchestra.run.trial194.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:18.439 INFO:teuthology.orchestra.run.trial194.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:18.440 INFO:teuthology.orchestra.run.trial194.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:09:18.440 INFO:teuthology.orchestra.run.trial194.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:18.440 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:09:18.440 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:09:18.485 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:09:18.492 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:09:18.496 DEBUG:teuthology.orchestra.run.trial194:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:18.521 INFO:teuthology.orchestra.run.trial194.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:18.523 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:18.523 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:09:18.523 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:09:18.523 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:09:18.523 INFO:teuthology.task.kernel:Installing distro kernel on host.d... 2026-02-18T03:09:18.523 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial194.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:09:18.523 DEBUG:teuthology.orchestra.run.trial194:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:18.524 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:09:18.529 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:09:18.552 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:09:18.559 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:09:18.587 INFO:teuthology.orchestra.run.trial194.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:18.588 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:18.588 DEBUG:teuthology.orchestra.run.trial194:> sudo rpm -qi grub2-tools 2026-02-18T03:09:18.639 INFO:teuthology.orchestra.run.trial078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:09:18.648 INFO:teuthology.orchestra.run.trial078.stderr:done 2026-02-18T03:09:18.649 DEBUG:teuthology.orchestra.run.trial078:> test -d /sys/firmware/efi 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:Name : grub2-tools 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:Epoch : 1 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:Version : 2.06 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:Release : 118.el9 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:Architecture: x86_64 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:Group : Unspecified 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:Size : 8393909 2026-02-18T03:09:18.655 INFO:teuthology.orchestra.run.trial194.stdout:License : GPLv3+ 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:Packager : builder@centos.org 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:Vendor : CentOS 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:Summary : Support tools for GRUB. 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:Description : 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:09:18.656 INFO:teuthology.orchestra.run.trial194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:09:18.657 INFO:teuthology.orchestra.run.trial194.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:09:18.657 INFO:teuthology.orchestra.run.trial194.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:09:18.657 INFO:teuthology.orchestra.run.trial194.stdout:hardware devices. 2026-02-18T03:09:18.657 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:09:18.657 INFO:teuthology.orchestra.run.trial194.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:09:18.658 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:09:18.659 INFO:teuthology.task.kernel:Updating grub on trial194 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:09:18.659 DEBUG:teuthology.orchestra.run.trial194:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:09:18.665 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:09:18.723 INFO:teuthology.orchestra.run.trial194.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:18.724 DEBUG:teuthology.orchestra.run.trial194:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:09:18.730 INFO:teuthology.orchestra.run.trial078.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:09:18.730 INFO:teuthology.orchestra.run.trial078.stdout:/boot/efi/EFI/centos 2026-02-18T03:09:18.732 DEBUG:teuthology.orchestra.run.trial078:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:09:18.788 INFO:teuthology.orchestra.run.trial194.stdout:/sbin/grubby 2026-02-18T03:09:18.789 INFO:teuthology.orchestra.run.trial194.stdout:yes 2026-02-18T03:09:18.790 DEBUG:teuthology.orchestra.run.trial194:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:09:18.799 INFO:teuthology.orchestra.run.trial078.stdout:no 2026-02-18T03:09:18.799 DEBUG:teuthology.orchestra.run.trial078:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:09:18.853 INFO:teuthology.orchestra.run.trial194.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:18.854 DEBUG:teuthology.orchestra.run.trial194:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:09:18.863 INFO:teuthology.orchestra.run.trial078.stdout:yes 2026-02-18T03:09:18.863 DEBUG:teuthology.orchestra.run.trial078:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:09:18.927 DEBUG:teuthology.orchestra.run.trial194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:09:18.928 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial078 2026-02-18T03:09:18.929 DEBUG:teuthology.orchestra.run.trial078:> sudo bash -c ' 2026-02-18T03:09:18.929 DEBUG:teuthology.orchestra.run.trial078:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:09:18.929 DEBUG:teuthology.orchestra.run.trial078:> ' 2026-02-18T03:09:19.108 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:19.129 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:19.139 INFO:teuthology.orchestra.run.trial194.stderr:Generating grub configuration file ... 2026-02-18T03:09:19.193 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:19.193 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:09:19.193 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:09:19.193 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:09:19.204 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:09:19.210 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:09:19.244 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:19.245 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:09:19.245 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:09:19.245 INFO:teuthology.orchestra.run.trial031.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:19.245 INFO:teuthology.orchestra.run.trial031.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:19.245 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:09:19.245 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:19.245 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:09:19.246 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:09:19.302 DEBUG:teuthology.orchestra.run.trial031:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:19.328 INFO:teuthology.orchestra.run.trial031.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:19.329 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:19.329 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:09:19.329 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:09:19.329 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:09:19.330 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-18T03:09:19.330 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial031.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:09:19.330 DEBUG:teuthology.orchestra.run.trial031:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:19.392 INFO:teuthology.orchestra.run.trial031.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:19.393 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:19.393 DEBUG:teuthology.orchestra.run.trial031:> sudo rpm -qi grub2-tools 2026-02-18T03:09:19.458 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Name : grub2-tools 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Epoch : 1 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Version : 2.06 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Release : 118.el9 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Architecture: x86_64 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Group : Unspecified 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Size : 8393909 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:License : GPLv3+ 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Packager : builder@centos.org 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Vendor : CentOS 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Summary : Support tools for GRUB. 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:Description : 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:09:19.461 INFO:teuthology.orchestra.run.trial031.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:09:19.462 INFO:teuthology.orchestra.run.trial031.stdout:hardware devices. 2026-02-18T03:09:19.462 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:09:19.462 INFO:teuthology.orchestra.run.trial031.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:09:19.462 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:09:19.462 INFO:teuthology.task.kernel:Updating grub on trial031 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:09:19.462 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:09:19.464 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:09:19.495 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:09:19.502 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:09:19.526 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:09:19.527 INFO:teuthology.orchestra.run.trial031.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:19.529 DEBUG:teuthology.orchestra.run.trial031:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:09:19.532 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:09:19.593 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/grubby 2026-02-18T03:09:19.594 INFO:teuthology.orchestra.run.trial031.stdout:yes 2026-02-18T03:09:19.594 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:09:19.615 INFO:teuthology.orchestra.run.trial194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:09:19.623 INFO:teuthology.orchestra.run.trial194.stderr:done 2026-02-18T03:09:19.625 DEBUG:teuthology.orchestra.run.trial194:> test -d /sys/firmware/efi 2026-02-18T03:09:19.639 DEBUG:teuthology.orchestra.run.trial194:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:09:19.657 INFO:teuthology.orchestra.run.trial031.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:19.657 DEBUG:teuthology.orchestra.run.trial031:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:09:19.703 INFO:teuthology.orchestra.run.trial194.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:09:19.704 INFO:teuthology.orchestra.run.trial194.stdout:/boot/efi/EFI/centos 2026-02-18T03:09:19.705 DEBUG:teuthology.orchestra.run.trial194:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:09:19.731 DEBUG:teuthology.orchestra.run.trial031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:09:19.770 INFO:teuthology.orchestra.run.trial194.stdout:no 2026-02-18T03:09:19.770 DEBUG:teuthology.orchestra.run.trial194:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:09:19.833 INFO:teuthology.orchestra.run.trial194.stdout:yes 2026-02-18T03:09:19.834 DEBUG:teuthology.orchestra.run.trial194:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:09:19.896 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial194 2026-02-18T03:09:19.897 DEBUG:teuthology.orchestra.run.trial194:> sudo bash -c ' 2026-02-18T03:09:19.897 DEBUG:teuthology.orchestra.run.trial194:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:09:19.897 DEBUG:teuthology.orchestra.run.trial194:> ' 2026-02-18T03:09:19.940 INFO:teuthology.orchestra.run.trial031.stderr:Generating grub configuration file ... 2026-02-18T03:09:20.002 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:09:20.009 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:09:20.259 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:09:20.265 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:09:20.298 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:09:20.304 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:09:20.327 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:09:20.333 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:09:20.417 INFO:teuthology.orchestra.run.trial031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:09:20.425 INFO:teuthology.orchestra.run.trial031.stderr:done 2026-02-18T03:09:20.426 DEBUG:teuthology.orchestra.run.trial031:> test -d /sys/firmware/efi 2026-02-18T03:09:20.442 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:09:20.507 INFO:teuthology.orchestra.run.trial031.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:09:20.507 INFO:teuthology.orchestra.run.trial031.stdout:/boot/efi/EFI/centos 2026-02-18T03:09:20.508 DEBUG:teuthology.orchestra.run.trial031:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:09:20.571 INFO:teuthology.orchestra.run.trial031.stdout:no 2026-02-18T03:09:20.572 DEBUG:teuthology.orchestra.run.trial031:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:09:20.637 INFO:teuthology.orchestra.run.trial031.stdout:yes 2026-02-18T03:09:20.637 DEBUG:teuthology.orchestra.run.trial031:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:09:20.701 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial031 2026-02-18T03:09:20.702 DEBUG:teuthology.orchestra.run.trial031:> sudo bash -c ' 2026-02-18T03:09:20.702 DEBUG:teuthology.orchestra.run.trial031:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:09:20.702 DEBUG:teuthology.orchestra.run.trial031:> ' 2026-02-18T03:09:22.119 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:22.141 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:22.310 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:22.311 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:09:22.311 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:09:22.311 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:09:22.362 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:09:22.362 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:09:22.362 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:09:22.362 INFO:teuthology.orchestra.run.trial119.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:22.362 INFO:teuthology.orchestra.run.trial119.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:22.362 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:09:22.362 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:09:22.362 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:09:22.363 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:09:22.418 DEBUG:teuthology.orchestra.run.trial119:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:22.443 INFO:teuthology.orchestra.run.trial119.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:22.445 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:22.445 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:09:22.445 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:09:22.445 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:09:22.445 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2026-02-18T03:09:22.445 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial119.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:09:22.445 DEBUG:teuthology.orchestra.run.trial119:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:09:22.509 INFO:teuthology.orchestra.run.trial119.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:09:22.510 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:09:22.510 DEBUG:teuthology.orchestra.run.trial119:> sudo rpm -qi grub2-tools 2026-02-18T03:09:22.578 INFO:teuthology.orchestra.run.trial119.stdout:Name : grub2-tools 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Epoch : 1 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Version : 2.06 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Release : 118.el9 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Architecture: x86_64 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Group : Unspecified 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Size : 8393909 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:License : GPLv3+ 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:09:22.579 INFO:teuthology.orchestra.run.trial119.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:Packager : builder@centos.org 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:Vendor : CentOS 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:Summary : Support tools for GRUB. 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:Description : 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:09:22.580 INFO:teuthology.orchestra.run.trial119.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:09:22.581 INFO:teuthology.orchestra.run.trial119.stdout:hardware devices. 2026-02-18T03:09:22.581 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:09:22.581 INFO:teuthology.orchestra.run.trial119.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:09:22.582 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:09:22.582 INFO:teuthology.task.kernel:Updating grub on trial119 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:09:22.582 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:09:22.647 INFO:teuthology.orchestra.run.trial119.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:22.649 DEBUG:teuthology.orchestra.run.trial119:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:09:22.713 INFO:teuthology.orchestra.run.trial119.stdout:/sbin/grubby 2026-02-18T03:09:22.714 INFO:teuthology.orchestra.run.trial119.stdout:yes 2026-02-18T03:09:22.714 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:09:22.778 INFO:teuthology.orchestra.run.trial119.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:09:22.779 DEBUG:teuthology.orchestra.run.trial119:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:09:22.852 DEBUG:teuthology.orchestra.run.trial119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:09:23.064 INFO:teuthology.orchestra.run.trial119.stderr:Generating grub configuration file ... 2026-02-18T03:09:23.127 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:09:23.134 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:09:23.384 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:09:23.391 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:09:23.423 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:09:23.429 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:09:23.453 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:09:23.459 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:09:23.541 INFO:teuthology.orchestra.run.trial119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:09:23.549 INFO:teuthology.orchestra.run.trial119.stderr:done 2026-02-18T03:09:23.551 DEBUG:teuthology.orchestra.run.trial119:> test -d /sys/firmware/efi 2026-02-18T03:09:23.567 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:09:23.634 INFO:teuthology.orchestra.run.trial119.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:09:23.634 INFO:teuthology.orchestra.run.trial119.stdout:/boot/efi/EFI/centos 2026-02-18T03:09:23.636 DEBUG:teuthology.orchestra.run.trial119:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:09:23.702 INFO:teuthology.orchestra.run.trial119.stdout:no 2026-02-18T03:09:23.702 DEBUG:teuthology.orchestra.run.trial119:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:09:23.767 INFO:teuthology.orchestra.run.trial119.stdout:yes 2026-02-18T03:09:23.767 DEBUG:teuthology.orchestra.run.trial119:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:09:23.831 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial119 2026-02-18T03:09:23.831 DEBUG:teuthology.orchestra.run.trial119:> sudo bash -c ' 2026-02-18T03:09:23.831 DEBUG:teuthology.orchestra.run.trial119:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:09:23.831 DEBUG:teuthology.orchestra.run.trial119:> ' 2026-02-18T03:09:46.471 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-18T03:09:46.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-18T03:09:46.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:09:47.885 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-18T03:09:47.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-18T03:09:47.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:09:48.971 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-18T03:09:48.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-18T03:09:48.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:09:49.940 INFO:teuthology.task.kernel:Checking client host.d for new kernel version... 2026-02-18T03:09:49.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-18T03:09:49.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:09:50.745 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-18T03:09:50.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-18T03:09:50.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:09:53.874 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2026-02-18T03:09:53.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-18T03:09:53.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:10:46.528 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:10:47.891 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:10:48.976 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:10:49.949 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:10:50.749 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:10:53.881 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:10:55.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-18T03:10:55.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:10:55.664 DEBUG:teuthology.orchestra.run.trial097:> true 2026-02-18T03:10:55.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-18T03:10:55.817 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:10:55.817 DEBUG:teuthology.orchestra.run.trial097:> uname -r 2026-02-18T03:10:55.873 INFO:teuthology.orchestra.run.trial097.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:10:55.874 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:10:55.874 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:10:55.874 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:10:56.875 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-18T03:10:56.875 DEBUG:teuthology.orchestra.run.trial097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:10:56.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-18T03:10:56.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:10:56.906 INFO:teuthology.orchestra.run.trial097.stdout:ttyS1 2026-02-18T03:10:57.005 DEBUG:teuthology.parallel:result is None 2026-02-18T03:10:57.025 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-18T03:10:57.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-18T03:10:57.180 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:10:57.181 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-18T03:10:57.236 INFO:teuthology.orchestra.run.trial114.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:10:57.237 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:10:57.237 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:10:57.237 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:10:57.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-18T03:10:57.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:10:58.109 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-18T03:10:58.237 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-18T03:10:58.237 DEBUG:teuthology.orchestra.run.trial114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:10:58.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-18T03:10:58.262 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:10:58.263 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-18T03:10:58.267 INFO:teuthology.orchestra.run.trial114.stdout:ttyS1 2026-02-18T03:10:58.293 DEBUG:teuthology.parallel:result is None 2026-02-18T03:10:58.318 INFO:teuthology.orchestra.run.trial078.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:10:58.318 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:10:58.319 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:10:58.319 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:10:58.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-18T03:10:58.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:10:59.083 DEBUG:teuthology.orchestra.run.trial194:> true 2026-02-18T03:10:59.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-18T03:10:59.236 INFO:teuthology.task.kernel:Checking kernel version of host.d, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:10:59.236 DEBUG:teuthology.orchestra.run.trial194:> uname -r 2026-02-18T03:10:59.294 INFO:teuthology.orchestra.run.trial194.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:10:59.294 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:10:59.294 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:10:59.294 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:10:59.320 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2026-02-18T03:10:59.320 DEBUG:teuthology.orchestra.run.trial078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:10:59.351 INFO:teuthology.orchestra.run.trial078.stdout:ttyS1 2026-02-18T03:10:59.371 DEBUG:teuthology.parallel:result is None 2026-02-18T03:10:59.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-18T03:10:59.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:10:59.885 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-18T03:11:00.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-18T03:11:00.040 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:11:00.041 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-18T03:11:00.098 INFO:teuthology.orchestra.run.trial031.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:11:00.098 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:11:00.098 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:11:00.098 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:11:00.295 INFO:teuthology.task.kernel:Enabling kdb on host.d... 2026-02-18T03:11:00.295 DEBUG:teuthology.orchestra.run.trial194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:11:00.324 INFO:teuthology.orchestra.run.trial194.stdout:ttyS1 2026-02-18T03:11:00.348 DEBUG:teuthology.parallel:result is None 2026-02-18T03:11:01.100 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2026-02-18T03:11:01.100 DEBUG:teuthology.orchestra.run.trial031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:11:01.129 INFO:teuthology.orchestra.run.trial031.stdout:ttyS1 2026-02-18T03:11:01.147 DEBUG:teuthology.parallel:result is None 2026-02-18T03:11:02.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-18T03:11:02.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:11:03.022 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-18T03:11:03.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-18T03:11:03.177 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:11:03.177 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-18T03:11:03.234 INFO:teuthology.orchestra.run.trial119.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:11:03.234 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:11:03.234 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:11:03.234 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:11:04.236 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2026-02-18T03:11:04.236 DEBUG:teuthology.orchestra.run.trial119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:11:04.265 INFO:teuthology.orchestra.run.trial119.stdout:ttyS1 2026-02-18T03:11:04.295 DEBUG:teuthology.parallel:result is None 2026-02-18T03:11:04.295 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-18T03:11:04.307 INFO:teuthology.task.internal:Creating test directory... 2026-02-18T03:11:04.308 DEBUG:teuthology.orchestra.run.trial031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:11:04.310 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:11:04.313 DEBUG:teuthology.orchestra.run.trial097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:11:04.316 DEBUG:teuthology.orchestra.run.trial114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:11:04.319 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:11:04.337 DEBUG:teuthology.orchestra.run.trial194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:11:04.355 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-18T03:11:04.366 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-18T03:11:04.380 INFO:teuthology.task.internal:Creating archive directory... 2026-02-18T03:11:04.380 DEBUG:teuthology.orchestra.run.trial031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:11:04.383 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:11:04.385 DEBUG:teuthology.orchestra.run.trial097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:11:04.388 DEBUG:teuthology.orchestra.run.trial114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:11:04.391 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:11:04.394 DEBUG:teuthology.orchestra.run.trial194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:11:04.420 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-18T03:11:04.432 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-18T03:11:04.432 DEBUG:teuthology.orchestra.run.trial031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:11:04.440 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:11:04.442 DEBUG:teuthology.orchestra.run.trial097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:11:04.445 DEBUG:teuthology.orchestra.run.trial114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:11:04.448 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:11:04.452 DEBUG:teuthology.orchestra.run.trial194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:11:04.462 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.464 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.468 INFO:teuthology.orchestra.run.trial097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.470 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.471 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.473 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.475 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.476 INFO:teuthology.orchestra.run.trial097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.477 INFO:teuthology.orchestra.run.trial194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.479 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.482 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.486 INFO:teuthology.orchestra.run.trial194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:11:04.488 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-18T03:11:04.500 INFO:teuthology.task.internal:Configuring sudo... 2026-02-18T03:11:04.500 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:11:04.514 DEBUG:teuthology.orchestra.run.trial078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:11:04.517 DEBUG:teuthology.orchestra.run.trial097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:11:04.520 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:11:04.523 DEBUG:teuthology.orchestra.run.trial119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:11:04.527 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:11:04.551 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-18T03:11:04.569 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-18T03:11:04.569 DEBUG:teuthology.orchestra.run.trial031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:11:04.580 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:11:04.583 DEBUG:teuthology.orchestra.run.trial097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:11:04.586 DEBUG:teuthology.orchestra.run.trial114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:11:04.588 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:11:04.590 DEBUG:teuthology.orchestra.run.trial194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:11:04.608 DEBUG:teuthology.orchestra.run.trial031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:04.756 DEBUG:teuthology.orchestra.run.trial031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:04.781 DEBUG:teuthology.orchestra.run.trial031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:04.917 DEBUG:teuthology.orchestra.run.trial031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:04.941 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:11:04.941 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:11:05.004 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:05.121 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:05.147 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:05.301 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:05.325 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:11:05.325 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:11:05.389 DEBUG:teuthology.orchestra.run.trial097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:05.507 DEBUG:teuthology.orchestra.run.trial097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:05.531 DEBUG:teuthology.orchestra.run.trial097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:05.657 DEBUG:teuthology.orchestra.run.trial097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:05.680 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:11:05.681 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:11:05.743 DEBUG:teuthology.orchestra.run.trial114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:05.961 DEBUG:teuthology.orchestra.run.trial114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:05.987 DEBUG:teuthology.orchestra.run.trial114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:06.149 DEBUG:teuthology.orchestra.run.trial114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:06.174 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:11:06.174 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:11:06.239 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:06.358 DEBUG:teuthology.orchestra.run.trial119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:06.383 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:06.528 DEBUG:teuthology.orchestra.run.trial119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:06.553 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:11:06.553 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:11:06.618 DEBUG:teuthology.orchestra.run.trial194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:06.736 DEBUG:teuthology.orchestra.run.trial194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:11:06.761 DEBUG:teuthology.orchestra.run.trial194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:06.908 DEBUG:teuthology.orchestra.run.trial194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:11:06.933 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:11:06.933 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:11:06.996 DEBUG:teuthology.orchestra.run.trial031:> sudo service rsyslog restart 2026-02-18T03:11:06.999 DEBUG:teuthology.orchestra.run.trial078:> sudo service rsyslog restart 2026-02-18T03:11:07.002 DEBUG:teuthology.orchestra.run.trial097:> sudo service rsyslog restart 2026-02-18T03:11:07.004 DEBUG:teuthology.orchestra.run.trial114:> sudo service rsyslog restart 2026-02-18T03:11:07.007 DEBUG:teuthology.orchestra.run.trial119:> sudo service rsyslog restart 2026-02-18T03:11:07.009 DEBUG:teuthology.orchestra.run.trial194:> sudo service rsyslog restart 2026-02-18T03:11:07.025 INFO:teuthology.orchestra.run.trial031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:11:07.028 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:11:07.031 INFO:teuthology.orchestra.run.trial097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:11:07.033 INFO:teuthology.orchestra.run.trial114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:11:07.035 INFO:teuthology.orchestra.run.trial119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:11:07.066 INFO:teuthology.orchestra.run.trial194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:11:07.555 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-18T03:11:07.568 INFO:teuthology.task.internal:Starting timer... 2026-02-18T03:11:07.569 INFO:teuthology.run_tasks:Running task pcp... 2026-02-18T03:11:07.590 INFO:teuthology.run_tasks:Running task selinux... 2026-02-18T03:11:07.608 DEBUG:teuthology.orchestra.run.trial031:> sudo service auditd rotate 2026-02-18T03:11:07.637 INFO:teuthology.orchestra.run.trial031.stdout:Rotating logs: 2026-02-18T03:11:07.639 DEBUG:teuthology.orchestra.run.trial078:> sudo service auditd rotate 2026-02-18T03:11:07.668 INFO:teuthology.orchestra.run.trial078.stdout:Rotating logs: 2026-02-18T03:11:07.670 DEBUG:teuthology.orchestra.run.trial097:> sudo service auditd rotate 2026-02-18T03:11:07.700 INFO:teuthology.orchestra.run.trial097.stdout:Rotating logs: 2026-02-18T03:11:07.702 DEBUG:teuthology.orchestra.run.trial114:> sudo service auditd rotate 2026-02-18T03:11:07.732 INFO:teuthology.orchestra.run.trial114.stdout:Rotating logs: 2026-02-18T03:11:07.734 DEBUG:teuthology.orchestra.run.trial119:> sudo service auditd rotate 2026-02-18T03:11:07.764 INFO:teuthology.orchestra.run.trial119.stdout:Rotating logs: 2026-02-18T03:11:07.765 DEBUG:teuthology.orchestra.run.trial194:> sudo service auditd rotate 2026-02-18T03:11:07.795 INFO:teuthology.orchestra.run.trial194.stdout:Rotating logs: 2026-02-18T03:11:07.797 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-18T03:11:07.798 DEBUG:teuthology.orchestra.run.trial031:> /usr/sbin/getenforce 2026-02-18T03:11:07.815 INFO:teuthology.orchestra.run.trial031.stdout:Permissive 2026-02-18T03:11:07.816 DEBUG:teuthology.orchestra.run.trial078:> /usr/sbin/getenforce 2026-02-18T03:11:07.833 INFO:teuthology.orchestra.run.trial078.stdout:Permissive 2026-02-18T03:11:07.834 DEBUG:teuthology.orchestra.run.trial097:> /usr/sbin/getenforce 2026-02-18T03:11:07.851 INFO:teuthology.orchestra.run.trial097.stdout:Permissive 2026-02-18T03:11:07.852 DEBUG:teuthology.orchestra.run.trial114:> /usr/sbin/getenforce 2026-02-18T03:11:07.869 INFO:teuthology.orchestra.run.trial114.stdout:Permissive 2026-02-18T03:11:07.870 DEBUG:teuthology.orchestra.run.trial119:> /usr/sbin/getenforce 2026-02-18T03:11:07.887 INFO:teuthology.orchestra.run.trial119.stdout:Permissive 2026-02-18T03:11:07.888 DEBUG:teuthology.orchestra.run.trial194:> /usr/sbin/getenforce 2026-02-18T03:11:07.905 INFO:teuthology.orchestra.run.trial194.stdout:Permissive 2026-02-18T03:11:07.906 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial031.front.sepia.ceph.com': 'permissive', 'ubuntu@trial078.front.sepia.ceph.com': 'permissive', 'ubuntu@trial097.front.sepia.ceph.com': 'permissive', 'ubuntu@trial114.front.sepia.ceph.com': 'permissive', 'ubuntu@trial119.front.sepia.ceph.com': 'permissive', 'ubuntu@trial194.front.sepia.ceph.com': 'permissive'} 2026-02-18T03:11:07.906 DEBUG:teuthology.orchestra.run.trial031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:11:07.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:11:07.933 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:11:07.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:11:07.960 DEBUG:teuthology.orchestra.run.trial097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:11:07.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:11:07.986 DEBUG:teuthology.orchestra.run.trial114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:11:08.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:11:08.013 DEBUG:teuthology.orchestra.run.trial119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:11:08.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:11:08.040 DEBUG:teuthology.orchestra.run.trial194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:11:08.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:11:08.067 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-18T03:11:08.067 DEBUG:teuthology.orchestra.run.trial031:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:11:08.092 DEBUG:teuthology.orchestra.run.trial078:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:11:08.117 DEBUG:teuthology.orchestra.run.trial097:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:11:08.143 DEBUG:teuthology.orchestra.run.trial114:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:11:08.169 DEBUG:teuthology.orchestra.run.trial119:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:11:08.194 DEBUG:teuthology.orchestra.run.trial194:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:11:08.219 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-18T03:11:08.237 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-18T03:11:08.241 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-18T03:11:08.363 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-18T03:11:08.374 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-18T03:11:08.376 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial031.front.sepia.ceph.com,trial078.front.sepia.ceph.com,trial097.front.sepia.ceph.com,trial114.front.sepia.ceph.com,trial119.front.sepia.ceph.com,trial194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-18T03:12:53.916 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial031.front.sepia.ceph.com'), Remote(name='ubuntu@trial078.front.sepia.ceph.com'), Remote(name='ubuntu@trial097.front.sepia.ceph.com'), Remote(name='ubuntu@trial114.front.sepia.ceph.com'), Remote(name='ubuntu@trial119.front.sepia.ceph.com'), Remote(name='ubuntu@trial194.front.sepia.ceph.com')] 2026-02-18T03:12:53.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-18T03:12:53.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:12:53.991 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-18T03:12:54.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-18T03:12:54.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-18T03:12:54.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:12:54.152 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-18T03:12:54.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-18T03:12:54.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-18T03:12:54.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:12:54.305 DEBUG:teuthology.orchestra.run.trial097:> true 2026-02-18T03:12:54.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-18T03:12:54.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-18T03:12:54.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:12:54.454 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-18T03:12:54.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-18T03:12:54.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-18T03:12:54.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:12:54.606 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-18T03:12:54.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-18T03:12:54.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-18T03:12:54.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:12:54.754 DEBUG:teuthology.orchestra.run.trial194:> true 2026-02-18T03:12:54.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-18T03:12:54.833 INFO:teuthology.run_tasks:Running task clock... 2026-02-18T03:12:54.849 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-18T03:12:54.849 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:12:54.849 DEBUG:teuthology.orchestra.run.trial031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:12:54.852 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:12:54.852 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:12:54.854 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:12:54.855 DEBUG:teuthology.orchestra.run.trial097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:12:54.857 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:12:54.857 DEBUG:teuthology.orchestra.run.trial114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:12:54.859 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:12:54.859 DEBUG:teuthology.orchestra.run.trial119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:12:54.862 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:12:54.862 DEBUG:teuthology.orchestra.run.trial194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:12:54.878 INFO:teuthology.orchestra.run.trial031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:12:54.882 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:12:54.882 INFO:teuthology.orchestra.run.trial097.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:12:54.885 INFO:teuthology.orchestra.run.trial114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:12:54.888 INFO:teuthology.orchestra.run.trial119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:12:54.890 INFO:teuthology.orchestra.run.trial031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:12:54.894 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:12:54.895 INFO:teuthology.orchestra.run.trial097.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:12:54.897 INFO:teuthology.orchestra.run.trial114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:12:54.899 INFO:teuthology.orchestra.run.trial194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:12:54.899 INFO:teuthology.orchestra.run.trial119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:12:54.910 INFO:teuthology.orchestra.run.trial031.stderr:sudo: ntpd: command not found 2026-02-18T03:12:54.910 INFO:teuthology.orchestra.run.trial194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:12:54.914 INFO:teuthology.orchestra.run.trial078.stderr:sudo: ntpd: command not found 2026-02-18T03:12:54.915 INFO:teuthology.orchestra.run.trial097.stderr:sudo: ntpd: command not found 2026-02-18T03:12:54.918 INFO:teuthology.orchestra.run.trial114.stderr:sudo: ntpd: command not found 2026-02-18T03:12:54.919 INFO:teuthology.orchestra.run.trial119.stderr:sudo: ntpd: command not found 2026-02-18T03:12:54.919 INFO:teuthology.orchestra.run.trial031.stdout:506 Cannot talk to daemon 2026-02-18T03:12:54.924 INFO:teuthology.orchestra.run.trial097.stdout:506 Cannot talk to daemon 2026-02-18T03:12:54.924 INFO:teuthology.orchestra.run.trial078.stdout:506 Cannot talk to daemon 2026-02-18T03:12:54.928 INFO:teuthology.orchestra.run.trial114.stdout:506 Cannot talk to daemon 2026-02-18T03:12:54.928 INFO:teuthology.orchestra.run.trial119.stdout:506 Cannot talk to daemon 2026-02-18T03:12:54.930 INFO:teuthology.orchestra.run.trial031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:12:54.930 INFO:teuthology.orchestra.run.trial194.stderr:sudo: ntpd: command not found 2026-02-18T03:12:54.935 INFO:teuthology.orchestra.run.trial097.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:12:54.936 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:12:54.939 INFO:teuthology.orchestra.run.trial119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:12:54.940 INFO:teuthology.orchestra.run.trial194.stdout:506 Cannot talk to daemon 2026-02-18T03:12:54.940 INFO:teuthology.orchestra.run.trial114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:12:54.942 INFO:teuthology.orchestra.run.trial031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:12:54.947 INFO:teuthology.orchestra.run.trial097.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:12:54.948 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:12:54.951 INFO:teuthology.orchestra.run.trial119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:12:54.952 INFO:teuthology.orchestra.run.trial194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:12:54.952 INFO:teuthology.orchestra.run.trial114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:12:54.963 INFO:teuthology.orchestra.run.trial194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:12:54.987 INFO:teuthology.orchestra.run.trial031.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:12:54.992 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:12:54.996 INFO:teuthology.orchestra.run.trial097.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:12:54.997 INFO:teuthology.orchestra.run.trial114.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:12:54.997 INFO:teuthology.orchestra.run.trial119.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:12:55.007 INFO:teuthology.orchestra.run.trial119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:12:55.007 INFO:teuthology.orchestra.run.trial119.stdout:=============================================================================== 2026-02-18T03:12:55.007 INFO:teuthology.orchestra.run.trial119.stdout:^? 50.205.57.38 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.007 INFO:teuthology.orchestra.run.trial119.stdout:^? 69-10-208-170.rainiercon> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.008 INFO:teuthology.orchestra.run.trial119.stdout:^? 155.248.196.28 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.008 INFO:teuthology.orchestra.run.trial119.stdout:^? 66.42.71.197.vultruserco> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.008 INFO:teuthology.orchestra.run.trial031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:12:55.008 INFO:teuthology.orchestra.run.trial031.stdout:=============================================================================== 2026-02-18T03:12:55.008 INFO:teuthology.orchestra.run.trial031.stdout:^? 23.186.168.131 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.008 INFO:teuthology.orchestra.run.trial031.stdout:^? 69-10-208-170.rainiercon> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.008 INFO:teuthology.orchestra.run.trial031.stdout:^? 155.248.196.28 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.008 INFO:teuthology.orchestra.run.trial031.stdout:^? 66.42.71.197.vultruserco> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.012 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:12:55.013 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-18T03:12:55.013 INFO:teuthology.orchestra.run.trial078.stdout:^? 172-235-154-118.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.013 INFO:teuthology.orchestra.run.trial078.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.013 INFO:teuthology.orchestra.run.trial078.stdout:^? ntp1.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.013 INFO:teuthology.orchestra.run.trial078.stdout:^? pool-96-231-54-150.washd> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.014 INFO:teuthology.orchestra.run.trial194.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:12:55.016 INFO:teuthology.orchestra.run.trial194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:12:55.016 INFO:teuthology.orchestra.run.trial194.stdout:=============================================================================== 2026-02-18T03:12:55.016 INFO:teuthology.orchestra.run.trial194.stdout:^? 172-235-154-118.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.016 INFO:teuthology.orchestra.run.trial194.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.016 INFO:teuthology.orchestra.run.trial194.stdout:^? ntp1.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.017 INFO:teuthology.orchestra.run.trial194.stdout:^? pool-96-231-54-150.washd> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.020 INFO:teuthology.orchestra.run.trial097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:12:55.020 INFO:teuthology.orchestra.run.trial097.stdout:=============================================================================== 2026-02-18T03:12:55.020 INFO:teuthology.orchestra.run.trial097.stdout:^? connected.by.freedominte> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.021 INFO:teuthology.orchestra.run.trial097.stdout:^? 108.61.73.244 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.021 INFO:teuthology.orchestra.run.trial097.stdout:^? 172-232-15-202.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.021 INFO:teuthology.orchestra.run.trial097.stdout:^? time-he.den.codehof.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.257 INFO:teuthology.orchestra.run.trial114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:12:55.257 INFO:teuthology.orchestra.run.trial114.stdout:=============================================================================== 2026-02-18T03:12:55.257 INFO:teuthology.orchestra.run.trial114.stdout:^? 23.186.168.131 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.257 INFO:teuthology.orchestra.run.trial114.stdout:^? nyc2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.258 INFO:teuthology.orchestra.run.trial114.stdout:^? ntp.sfo.icanbwell.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.258 INFO:teuthology.orchestra.run.trial114.stdout:^? 69.9.131.124 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T03:12:55.259 INFO:teuthology.run_tasks:Running task install... 2026-02-18T03:12:55.273 DEBUG:teuthology.task.install:project ceph 2026-02-18T03:12:55.273 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'}} 2026-02-18T03:12:55.274 DEBUG:teuthology.task.install:config {'extra_packages': ['nvme-cli'], 'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'} 2026-02-18T03:12:55.274 INFO:teuthology.task.install:Using flavor: default 2026-02-18T03:12:55.282 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-18T03:12:55.282 INFO:teuthology.task.install:extra packages: ['nvme-cli'] 2026-02-18T03:12:55.283 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:12:55.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:12:55.286 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:12:55.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:12:55.288 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:12:55.288 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:12:55.290 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:12:55.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:12:55.291 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:12:55.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:12:55.292 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:12:55.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:12:55.660 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:12:55.660 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:12:55.671 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:12:55.671 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:12:55.672 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:12:55.672 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:12:55.672 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:12:55.672 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:12:55.673 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:12:55.673 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:12:55.673 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:12:55.673 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:12:55.983 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:12:55.983 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:12:55.983 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:12:55.989 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:12:55.989 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:12:55.989 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:12:55.990 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:12:55.990 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:12:55.990 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:12:55.990 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:12:55.990 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:12:55.990 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:12:55.990 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:12:55.990 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:12:55.990 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:12:55.992 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:12:55.992 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:12:55.992 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:12:56.015 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:12:56.016 DEBUG:teuthology.orchestra.run.trial114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:12:56.017 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:12:56.017 DEBUG:teuthology.orchestra.run.trial119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:12:56.018 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:12:56.018 DEBUG:teuthology.orchestra.run.trial097:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:12:56.018 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:12:56.018 DEBUG:teuthology.orchestra.run.trial194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:12:56.019 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:12:56.019 DEBUG:teuthology.orchestra.run.trial078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:12:56.019 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:12:56.019 DEBUG:teuthology.orchestra.run.trial031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:12:56.079 DEBUG:teuthology.orchestra.run.trial114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:12:56.082 DEBUG:teuthology.orchestra.run.trial119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:12:56.082 DEBUG:teuthology.orchestra.run.trial097:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:12:56.083 DEBUG:teuthology.orchestra.run.trial078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:12:56.083 DEBUG:teuthology.orchestra.run.trial194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:12:56.084 DEBUG:teuthology.orchestra.run.trial031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:12:56.153 DEBUG:teuthology.orchestra.run.trial114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:12:56.154 DEBUG:teuthology.orchestra.run.trial119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:12:56.156 DEBUG:teuthology.orchestra.run.trial097:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:12:56.157 DEBUG:teuthology.orchestra.run.trial031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:12:56.159 DEBUG:teuthology.orchestra.run.trial194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:12:56.159 DEBUG:teuthology.orchestra.run.trial078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:12:56.217 INFO:teuthology.orchestra.run.trial114.stdout:check_obsoletes = 1 2026-02-18T03:12:56.218 DEBUG:teuthology.orchestra.run.trial114:> sudo yum clean all 2026-02-18T03:12:56.219 INFO:teuthology.orchestra.run.trial119.stdout:check_obsoletes = 1 2026-02-18T03:12:56.220 INFO:teuthology.orchestra.run.trial097.stdout:check_obsoletes = 1 2026-02-18T03:12:56.221 DEBUG:teuthology.orchestra.run.trial119:> sudo yum clean all 2026-02-18T03:12:56.222 INFO:teuthology.orchestra.run.trial031.stdout:check_obsoletes = 1 2026-02-18T03:12:56.223 DEBUG:teuthology.orchestra.run.trial097:> sudo yum clean all 2026-02-18T03:12:56.223 DEBUG:teuthology.orchestra.run.trial031:> sudo yum clean all 2026-02-18T03:12:56.224 INFO:teuthology.orchestra.run.trial078.stdout:check_obsoletes = 1 2026-02-18T03:12:56.225 DEBUG:teuthology.orchestra.run.trial078:> sudo yum clean all 2026-02-18T03:12:56.226 INFO:teuthology.orchestra.run.trial194.stdout:check_obsoletes = 1 2026-02-18T03:12:56.226 DEBUG:teuthology.orchestra.run.trial194:> sudo yum clean all 2026-02-18T03:12:56.368 INFO:teuthology.orchestra.run.trial119.stdout:41 files removed 2026-02-18T03:12:56.369 INFO:teuthology.orchestra.run.trial114.stdout:41 files removed 2026-02-18T03:12:56.372 INFO:teuthology.orchestra.run.trial097.stdout:41 files removed 2026-02-18T03:12:56.373 INFO:teuthology.orchestra.run.trial031.stdout:41 files removed 2026-02-18T03:12:56.376 INFO:teuthology.orchestra.run.trial078.stdout:41 files removed 2026-02-18T03:12:56.376 INFO:teuthology.orchestra.run.trial194.stdout:41 files removed 2026-02-18T03:12:56.382 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-radosgw 2026-02-18T03:12:56.384 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-radosgw 2026-02-18T03:12:56.387 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-radosgw 2026-02-18T03:12:56.388 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-radosgw 2026-02-18T03:12:56.390 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-radosgw 2026-02-18T03:12:56.393 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-radosgw 2026-02-18T03:12:56.655 INFO:teuthology.orchestra.run.trial119.stdout:ceph packages for x86_64 694 kB/s | 89 kB 00:00 2026-02-18T03:12:56.660 INFO:teuthology.orchestra.run.trial097.stdout:ceph packages for x86_64 707 kB/s | 89 kB 00:00 2026-02-18T03:12:56.660 INFO:teuthology.orchestra.run.trial114.stdout:ceph packages for x86_64 695 kB/s | 89 kB 00:00 2026-02-18T03:12:56.662 INFO:teuthology.orchestra.run.trial031.stdout:ceph packages for x86_64 680 kB/s | 89 kB 00:00 2026-02-18T03:12:56.662 INFO:teuthology.orchestra.run.trial078.stdout:ceph packages for x86_64 715 kB/s | 89 kB 00:00 2026-02-18T03:12:56.667 INFO:teuthology.orchestra.run.trial194.stdout:ceph packages for x86_64 694 kB/s | 89 kB 00:00 2026-02-18T03:12:56.793 INFO:teuthology.orchestra.run.trial119.stdout:ceph noarch packages 166 kB/s | 19 kB 00:00 2026-02-18T03:12:56.801 INFO:teuthology.orchestra.run.trial114.stdout:ceph noarch packages 162 kB/s | 19 kB 00:00 2026-02-18T03:12:56.801 INFO:teuthology.orchestra.run.trial097.stdout:ceph noarch packages 161 kB/s | 19 kB 00:00 2026-02-18T03:12:56.802 INFO:teuthology.orchestra.run.trial031.stdout:ceph noarch packages 166 kB/s | 19 kB 00:00 2026-02-18T03:12:56.803 INFO:teuthology.orchestra.run.trial078.stdout:ceph noarch packages 163 kB/s | 19 kB 00:00 2026-02-18T03:12:56.807 INFO:teuthology.orchestra.run.trial194.stdout:ceph noarch packages 163 kB/s | 19 kB 00:00 2026-02-18T03:12:56.917 INFO:teuthology.orchestra.run.trial119.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:12:56.925 INFO:teuthology.orchestra.run.trial097.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:12:56.925 INFO:teuthology.orchestra.run.trial114.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:12:56.926 INFO:teuthology.orchestra.run.trial031.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:12:56.928 INFO:teuthology.orchestra.run.trial078.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:12:56.931 INFO:teuthology.orchestra.run.trial194.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:12:57.706 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-18T03:12:57.707 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-18T03:12:57.884 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.9 MB 00:00 2026-02-18T03:12:57.888 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.9 MB 00:00 2026-02-18T03:12:57.936 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.9 MB 00:00 2026-02-18T03:12:58.766 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - AppStream 77 MB/s | 27 MB 00:00 2026-02-18T03:13:01.094 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-18T03:13:01.186 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 27 MB 00:02 2026-02-18T03:13:01.388 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 27 MB 00:03 2026-02-18T03:13:01.429 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-18T03:13:01.610 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - CRB 18 MB/s | 7.8 MB 00:00 2026-02-18T03:13:02.782 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 20 kB 00:00 2026-02-18T03:13:03.112 INFO:teuthology.orchestra.run.trial194.stdout:Extra Packages for Enterprise Linux 76 MB/s | 20 MB 00:00 2026-02-18T03:13:04.433 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 7.8 MB 00:00 2026-02-18T03:13:04.950 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 7.8 MB 00:01 2026-02-18T03:13:05.371 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 20 kB 00:00 2026-02-18T03:13:05.716 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-18T03:13:05.779 INFO:teuthology.orchestra.run.trial097.stdout:Extra Packages for Enterprise Linux 59 MB/s | 20 MB 00:00 2026-02-18T03:13:05.981 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 20 kB 00:00 2026-02-18T03:13:06.312 INFO:teuthology.orchestra.run.trial194.stdout:lab-extras 2.2 MB/s | 50 kB 00:00 2026-02-18T03:13:07.009 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-18T03:13:07.549 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:07.550 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:07.550 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-18T03:13:07.550 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:07.550 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:07.550 INFO:teuthology.orchestra.run.trial194.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout:Upgrading: 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout:Installing weak dependencies: 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout:Install 35 Packages 2026-02-18T03:13:07.551 INFO:teuthology.orchestra.run.trial194.stdout:Upgrade 2 Packages 2026-02-18T03:13:07.552 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:07.552 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 79 M 2026-02-18T03:13:07.552 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:08.136 INFO:teuthology.orchestra.run.trial194.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 16 MB/s | 5.9 MB 00:00 2026-02-18T03:13:08.174 INFO:teuthology.orchestra.run.trial194.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 669 kB/s | 25 kB 00:00 2026-02-18T03:13:08.217 INFO:teuthology.orchestra.run.trial194.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 829 kB/s | 35 kB 00:00 2026-02-18T03:13:08.261 INFO:teuthology.orchestra.run.trial194.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 545 kB/s | 24 kB 00:00 2026-02-18T03:13:08.324 INFO:teuthology.orchestra.run.trial194.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 13 MB/s | 869 kB 00:00 2026-02-18T03:13:08.378 INFO:teuthology.orchestra.run.trial194.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 4.6 MB/s | 250 kB 00:00 2026-02-18T03:13:08.755 INFO:teuthology.orchestra.run.trial194.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 17 MB/s | 6.4 MB 00:00 2026-02-18T03:13:08.791 INFO:teuthology.orchestra.run.trial194.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.2 MB/s | 45 kB 00:00 2026-02-18T03:13:08.862 INFO:teuthology.orchestra.run.trial194.stdout:(9/37): ceph-common-20.2.0-670.gadc19233.el9.x8 22 MB/s | 24 MB 00:01 2026-02-18T03:13:08.863 INFO:teuthology.orchestra.run.trial194.stdout:(10/37): python3-ceph-common-20.2.0-670.gadc192 2.4 MB/s | 175 kB 00:00 2026-02-18T03:13:08.884 INFO:teuthology.orchestra.run.trial194.stdout:(11/37): python3-cephfs-20.2.0-670.gadc19233.el 7.3 MB/s | 162 kB 00:00 2026-02-18T03:13:08.890 INFO:teuthology.orchestra.run.trial194.stdout:(12/37): python3-rados-20.2.0-670.gadc19233.el9 12 MB/s | 323 kB 00:00 2026-02-18T03:13:08.913 INFO:teuthology.orchestra.run.trial194.stdout:(13/37): python3-rbd-20.2.0-670.gadc19233.el9.x 10 MB/s | 305 kB 00:00 2026-02-18T03:13:08.915 INFO:teuthology.orchestra.run.trial194.stdout:(14/37): python3-rgw-20.2.0-670.gadc19233.el9.x 3.9 MB/s | 99 kB 00:00 2026-02-18T03:13:08.971 INFO:teuthology.orchestra.run.trial194.stdout:(15/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 20 MB/s | 24 MB 00:01 2026-02-18T03:13:08.989 INFO:teuthology.orchestra.run.trial097.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-18T03:13:09.013 INFO:teuthology.orchestra.run.trial194.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 330 kB/s | 33 kB 00:00 2026-02-18T03:13:09.035 INFO:teuthology.orchestra.run.trial194.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 1.4 MB/s | 93 kB 00:00 2026-02-18T03:13:09.057 INFO:teuthology.orchestra.run.trial194.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 2.4 MB/s | 104 kB 00:00 2026-02-18T03:13:09.078 INFO:teuthology.orchestra.run.trial194.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-18T03:13:09.080 INFO:teuthology.orchestra.run.trial194.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.7 MB/s | 160 kB 00:00 2026-02-18T03:13:09.097 INFO:teuthology.orchestra.run.trial194.stdout:(21/37): nvme-cli-2.13-1.el9.x86_64.rpm 6.0 MB/s | 1.1 MB 00:00 2026-02-18T03:13:09.100 INFO:teuthology.orchestra.run.trial194.stdout:(22/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-18T03:13:09.121 INFO:teuthology.orchestra.run.trial194.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-18T03:13:09.124 INFO:teuthology.orchestra.run.trial194.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-18T03:13:09.134 INFO:teuthology.orchestra.run.trial194.stdout:(25/37): librdkafka-1.6.1-102.el9.x86_64.rpm 12 MB/s | 662 kB 00:00 2026-02-18T03:13:09.143 INFO:teuthology.orchestra.run.trial194.stdout:(26/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-18T03:13:09.146 INFO:teuthology.orchestra.run.trial194.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-18T03:13:09.544 INFO:teuthology.orchestra.run.trial194.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 62 kB/s | 25 kB 00:00 2026-02-18T03:13:09.700 INFO:teuthology.orchestra.run.trial194.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 312 kB/s | 49 kB 00:00 2026-02-18T03:13:09.857 INFO:teuthology.orchestra.run.trial194.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 430 kB/s | 67 kB 00:00 2026-02-18T03:13:09.999 INFO:teuthology.orchestra.run.trial194.stdout:(31/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 356 kB/s | 308 kB 00:00 2026-02-18T03:13:10.176 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:13:10.221 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:10.222 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:10.222 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repository Size 2026-02-18T03:13:10.222 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout:Upgrading: 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:13:10.223 INFO:teuthology.orchestra.run.trial097.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:13:10.224 INFO:teuthology.orchestra.run.trial097.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:13:10.225 INFO:teuthology.orchestra.run.trial097.stdout:Installing weak dependencies: 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout:Install 35 Packages 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout:Upgrade 2 Packages 2026-02-18T03:13:10.226 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:10.227 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 79 M 2026-02-18T03:13:10.227 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:10.233 INFO:teuthology.orchestra.run.trial194.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 817 kB/s | 191 kB 00:00 2026-02-18T03:13:10.872 INFO:teuthology.orchestra.run.trial194.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 826 kB/s | 838 kB 00:01 2026-02-18T03:13:10.987 INFO:teuthology.orchestra.run.trial194.stdout:(34/37): librados2-20.2.0-670.gadc19233.el9.x86 30 MB/s | 3.5 MB 00:00 2026-02-18T03:13:11.040 INFO:teuthology.orchestra.run.trial194.stdout:(35/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 54 MB/s | 2.8 MB 00:00 2026-02-18T03:13:11.378 INFO:teuthology.orchestra.run.trial097.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 16 MB/s | 5.9 MB 00:00 2026-02-18T03:13:11.404 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:11.405 INFO:teuthology.orchestra.run.trial097.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 934 kB/s | 25 kB 00:00 2026-02-18T03:13:11.405 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout:Upgrading: 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-18T03:13:11.406 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:13:11.407 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:13:11.408 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout:Installing weak dependencies: 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:11.409 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:11.410 INFO:teuthology.orchestra.run.trial078.stdout:Install 35 Packages 2026-02-18T03:13:11.410 INFO:teuthology.orchestra.run.trial078.stdout:Upgrade 2 Packages 2026-02-18T03:13:11.410 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:11.410 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 79 M 2026-02-18T03:13:11.410 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:11.438 INFO:teuthology.orchestra.run.trial097.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 1.0 MB/s | 35 kB 00:00 2026-02-18T03:13:11.471 INFO:teuthology.orchestra.run.trial097.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 722 kB/s | 24 kB 00:00 2026-02-18T03:13:11.523 INFO:teuthology.orchestra.run.trial097.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 17 MB/s | 869 kB 00:00 2026-02-18T03:13:11.563 INFO:teuthology.orchestra.run.trial097.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 6.1 MB/s | 250 kB 00:00 2026-02-18T03:13:11.876 INFO:teuthology.orchestra.run.trial097.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 20 MB/s | 6.4 MB 00:00 2026-02-18T03:13:11.916 INFO:teuthology.orchestra.run.trial097.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.1 MB/s | 45 kB 00:00 2026-02-18T03:13:11.964 INFO:teuthology.orchestra.run.trial097.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 3.6 MB/s | 175 kB 00:00 2026-02-18T03:13:12.014 INFO:teuthology.orchestra.run.trial097.stdout:(10/37): python3-cephfs-20.2.0-670.gadc19233.el 3.2 MB/s | 162 kB 00:00 2026-02-18T03:13:12.071 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - CRB 922 kB/s | 7.8 MB 00:08 2026-02-18T03:13:12.091 INFO:teuthology.orchestra.run.trial097.stdout:(11/37): ceph-common-20.2.0-670.gadc19233.el9.x 22 MB/s | 24 MB 00:01 2026-02-18T03:13:12.092 INFO:teuthology.orchestra.run.trial097.stdout:(12/37): python3-rados-20.2.0-670.gadc19233.el9 4.0 MB/s | 323 kB 00:00 2026-02-18T03:13:12.102 INFO:teuthology.orchestra.run.trial194.stdout:(36/37): thrift-0.15.0-4.el9.x86_64.rpm 867 kB/s | 1.6 MB 00:01 2026-02-18T03:13:12.103 INFO:teuthology.orchestra.run.trial097.stdout:(13/37): python3-rbd-20.2.0-670.gadc19233.el9.x 24 MB/s | 305 kB 00:00 2026-02-18T03:13:12.118 INFO:teuthology.orchestra.run.trial097.stdout:(14/37): python3-rgw-20.2.0-670.gadc19233.el9.x 3.8 MB/s | 99 kB 00:00 2026-02-18T03:13:12.237 INFO:teuthology.orchestra.run.trial097.stdout:(15/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 19 MB/s | 24 MB 00:01 2026-02-18T03:13:12.367 INFO:teuthology.orchestra.run.trial097.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 126 kB/s | 33 kB 00:00 2026-02-18T03:13:12.436 INFO:teuthology.orchestra.run.trial097.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.5 MB/s | 104 kB 00:00 2026-02-18T03:13:12.471 INFO:teuthology.orchestra.run.trial097.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 4.6 MB/s | 164 kB 00:00 2026-02-18T03:13:12.472 INFO:teuthology.orchestra.run.trial078.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 10 MB/s | 5.9 MB 00:00 2026-02-18T03:13:12.484 INFO:teuthology.orchestra.run.trial078.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 2.1 MB/s | 25 kB 00:00 2026-02-18T03:13:12.499 INFO:teuthology.orchestra.run.trial078.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 2.3 MB/s | 35 kB 00:00 2026-02-18T03:13:12.505 INFO:teuthology.orchestra.run.trial097.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.6 MB/s | 160 kB 00:00 2026-02-18T03:13:12.514 INFO:teuthology.orchestra.run.trial078.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 1.5 MB/s | 24 kB 00:00 2026-02-18T03:13:12.535 INFO:teuthology.orchestra.run.trial097.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 45 kB 00:00 2026-02-18T03:13:12.563 INFO:teuthology.orchestra.run.trial078.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 17 MB/s | 869 kB 00:00 2026-02-18T03:13:12.576 INFO:teuthology.orchestra.run.trial097.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 662 kB 00:00 2026-02-18T03:13:12.585 INFO:teuthology.orchestra.run.trial078.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 11 MB/s | 250 kB 00:00 2026-02-18T03:13:12.608 INFO:teuthology.orchestra.run.trial097.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.1 MB/s | 292 kB 00:00 2026-02-18T03:13:12.629 INFO:teuthology.orchestra.run.trial097.stdout:(23/37): pciutils-3.7.0-7.el9.x86_64.rpm 238 kB/s | 93 kB 00:00 2026-02-18T03:13:12.660 INFO:teuthology.orchestra.run.trial097.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.2 MB/s | 37 kB 00:00 2026-02-18T03:13:12.694 INFO:teuthology.orchestra.run.trial097.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.9 MB/s | 66 kB 00:00 2026-02-18T03:13:12.745 INFO:teuthology.orchestra.run.trial097.stdout:(26/37): qatlib-25.08.0-2.el9.x86_64.rpm 1.7 MB/s | 240 kB 00:00 2026-02-18T03:13:12.787 INFO:teuthology.orchestra.run.trial097.stdout:(27/37): nvme-cli-2.13-1.el9.x86_64.rpm 1.6 MB/s | 1.1 MB 00:00 2026-02-18T03:13:12.884 INFO:teuthology.orchestra.run.trial097.stdout:(28/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2026-02-18T03:13:12.886 INFO:teuthology.orchestra.run.trial097.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 251 kB/s | 25 kB 00:00 2026-02-18T03:13:12.910 INFO:teuthology.orchestra.run.trial097.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2026-02-18T03:13:12.913 INFO:teuthology.orchestra.run.trial097.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 2.4 MB/s | 67 kB 00:00 2026-02-18T03:13:12.968 INFO:teuthology.orchestra.run.trial078.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 17 MB/s | 6.4 MB 00:00 2026-02-18T03:13:12.976 INFO:teuthology.orchestra.run.trial097.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-18T03:13:12.982 INFO:teuthology.orchestra.run.trial097.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-18T03:13:12.986 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - CRB 871 kB/s | 7.8 MB 00:09 2026-02-18T03:13:12.999 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 20 kB 00:00 2026-02-18T03:13:13.002 INFO:teuthology.orchestra.run.trial078.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.3 MB/s | 45 kB 00:00 2026-02-18T03:13:13.029 INFO:teuthology.orchestra.run.trial097.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-18T03:13:13.031 INFO:teuthology.orchestra.run.trial097.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 29 MB/s | 1.6 MB 00:00 2026-02-18T03:13:13.042 INFO:teuthology.orchestra.run.trial078.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 4.2 MB/s | 175 kB 00:00 2026-02-18T03:13:13.090 INFO:teuthology.orchestra.run.trial078.stdout:(10/37): python3-cephfs-20.2.0-670.gadc19233.el 3.4 MB/s | 162 kB 00:00 2026-02-18T03:13:13.151 INFO:teuthology.orchestra.run.trial078.stdout:(11/37): python3-rados-20.2.0-670.gadc19233.el9 5.2 MB/s | 323 kB 00:00 2026-02-18T03:13:13.222 INFO:teuthology.orchestra.run.trial078.stdout:(12/37): python3-rbd-20.2.0-670.gadc19233.el9.x 4.2 MB/s | 305 kB 00:00 2026-02-18T03:13:13.278 INFO:teuthology.orchestra.run.trial078.stdout:(13/37): python3-rgw-20.2.0-670.gadc19233.el9.x 1.7 MB/s | 99 kB 00:00 2026-02-18T03:13:13.289 INFO:teuthology.orchestra.run.trial097.stdout:(36/37): librados2-20.2.0-670.gadc19233.el9.x86 11 MB/s | 3.5 MB 00:00 2026-02-18T03:13:13.311 INFO:teuthology.orchestra.run.trial114.stdout:Extra Packages for Enterprise Linux 81 MB/s | 20 MB 00:00 2026-02-18T03:13:13.318 INFO:teuthology.orchestra.run.trial078.stdout:(14/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 17 MB/s | 24 MB 00:01 2026-02-18T03:13:13.326 INFO:teuthology.orchestra.run.trial097.stdout:(37/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 9.6 MB/s | 2.8 MB 00:00 2026-02-18T03:13:13.329 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:13.329 INFO:teuthology.orchestra.run.trial097.stdout:Total 25 MB/s | 79 MB 00:03 2026-02-18T03:13:13.378 INFO:teuthology.orchestra.run.trial078.stdout:(15/37): ceph-common-20.2.0-670.gadc19233.el9.x 16 MB/s | 24 MB 00:01 2026-02-18T03:13:13.392 INFO:teuthology.orchestra.run.trial078.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 290 kB/s | 33 kB 00:00 2026-02-18T03:13:13.399 INFO:teuthology.orchestra.run.trial078.stdout:(17/37): nvme-cli-2.13-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2026-02-18T03:13:13.407 INFO:teuthology.orchestra.run.trial078.stdout:(18/37): pciutils-3.7.0-7.el9.x86_64.rpm 3.2 MB/s | 93 kB 00:00 2026-02-18T03:13:13.431 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:13.436 INFO:teuthology.orchestra.run.trial078.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 2.3 MB/s | 104 kB 00:00 2026-02-18T03:13:13.441 INFO:teuthology.orchestra.run.trial078.stdout:(20/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.8 MB/s | 164 kB 00:00 2026-02-18T03:13:13.446 INFO:teuthology.orchestra.run.trial078.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.9 MB/s | 45 kB 00:00 2026-02-18T03:13:13.448 INFO:teuthology.orchestra.run.trial078.stdout:(22/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2026-02-18T03:13:13.449 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:13.449 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:13.465 INFO:teuthology.orchestra.run.trial078.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 14 MB/s | 240 kB 00:00 2026-02-18T03:13:13.467 INFO:teuthology.orchestra.run.trial078.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 13 MB/s | 292 kB 00:00 2026-02-18T03:13:13.468 INFO:teuthology.orchestra.run.trial078.stdout:(25/37): librdkafka-1.6.1-102.el9.x86_64.rpm 24 MB/s | 662 kB 00:00 2026-02-18T03:13:13.474 INFO:teuthology.orchestra.run.trial078.stdout:(26/37): qatlib-service-25.08.0-2.el9.x86_64.rp 4.4 MB/s | 37 kB 00:00 2026-02-18T03:13:13.476 INFO:teuthology.orchestra.run.trial078.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.5 MB/s | 66 kB 00:00 2026-02-18T03:13:13.642 INFO:teuthology.orchestra.run.trial078.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 149 kB/s | 25 kB 00:00 2026-02-18T03:13:13.719 INFO:teuthology.orchestra.run.trial078.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 634 kB/s | 49 kB 00:00 2026-02-18T03:13:13.746 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:13.746 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:13.758 INFO:teuthology.orchestra.run.trial078.stdout:(30/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-18T03:13:13.775 INFO:teuthology.orchestra.run.trial078.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2026-02-18T03:13:13.795 INFO:teuthology.orchestra.run.trial194.stdout:(37/37): libarrow-9.0.0-15.el9.x86_64.rpm 971 kB/s | 4.4 MB 00:04 2026-02-18T03:13:13.797 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:13.797 INFO:teuthology.orchestra.run.trial194.stdout:Total 13 MB/s | 79 MB 00:06 2026-02-18T03:13:13.867 INFO:teuthology.orchestra.run.trial078.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2026-02-18T03:13:13.873 INFO:teuthology.orchestra.run.trial078.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.1 MB/s | 838 kB 00:00 2026-02-18T03:13:13.899 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:13.909 INFO:teuthology.orchestra.run.trial078.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2026-02-18T03:13:13.917 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:13.917 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:13.978 INFO:teuthology.orchestra.run.trial078.stdout:(35/37): librados2-20.2.0-670.gadc19233.el9.x86 34 MB/s | 3.5 MB 00:00 2026-02-18T03:13:14.003 INFO:teuthology.orchestra.run.trial078.stdout:(36/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 30 MB/s | 2.8 MB 00:00 2026-02-18T03:13:14.023 INFO:teuthology.orchestra.run.trial078.stdout:(37/37): thrift-0.15.0-4.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2026-02-18T03:13:14.026 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:14.026 INFO:teuthology.orchestra.run.trial078.stdout:Total 30 MB/s | 79 MB 00:02 2026-02-18T03:13:14.028 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 20 kB 00:00 2026-02-18T03:13:14.088 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:14.100 INFO:teuthology.orchestra.run.trial097.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:13:14.121 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:14.139 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:14.139 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:14.214 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:14.215 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:14.253 INFO:teuthology.orchestra.run.trial097.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:13:14.258 INFO:teuthology.orchestra.run.trial097.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:14.306 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:14.307 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:14.319 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:14.321 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:14.321 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:14.349 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:14.352 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:14.359 INFO:teuthology.orchestra.run.trial097.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:13:14.361 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:13:14.364 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:13:14.369 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:13:14.377 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:13:14.389 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:14.390 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:14.404 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:14.435 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:14.436 INFO:teuthology.orchestra.run.trial097.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:13:14.436 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:14.440 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:13:14.446 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:13:14.448 INFO:teuthology.orchestra.run.trial097.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:13:14.453 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:13:14.509 INFO:teuthology.orchestra.run.trial031.stdout:Extra Packages for Enterprise Linux 48 MB/s | 20 MB 00:00 2026-02-18T03:13:14.553 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:14.565 INFO:teuthology.orchestra.run.trial194.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:13:14.575 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:14.576 INFO:teuthology.orchestra.run.trial097.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:14.602 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:14.604 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:13:14.608 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 27 MB 00:08 2026-02-18T03:13:14.610 INFO:teuthology.orchestra.run.trial097.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:13:14.719 INFO:teuthology.orchestra.run.trial194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:13:14.723 INFO:teuthology.orchestra.run.trial194.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:14.775 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:14.776 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:14.777 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:14.789 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:14.789 INFO:teuthology.orchestra.run.trial078.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:13:14.793 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:14.794 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:14.822 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:14.824 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:14.832 INFO:teuthology.orchestra.run.trial194.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:13:14.835 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:13:14.838 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:13:14.842 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:13:14.851 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:13:14.862 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:14.863 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:14.876 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:14.888 INFO:teuthology.orchestra.run.trial097.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:13:14.890 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:14.907 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:14.907 INFO:teuthology.orchestra.run.trial194.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:13:14.911 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:13:14.911 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:13:14.916 INFO:teuthology.orchestra.run.trial097.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:13:14.917 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:13:14.919 INFO:teuthology.orchestra.run.trial097.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:13:14.919 INFO:teuthology.orchestra.run.trial194.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:13:14.919 INFO:teuthology.orchestra.run.trial097.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:14.923 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:13:14.939 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:14.942 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:13:14.948 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:14.995 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:14.996 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:15.008 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:15.011 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:15.012 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:15.040 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:15.044 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:15.045 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:15.047 INFO:teuthology.orchestra.run.trial194.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:15.053 INFO:teuthology.orchestra.run.trial078.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:13:15.053 INFO:teuthology.orchestra.run.trial097.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:13:15.055 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:13:15.056 INFO:teuthology.orchestra.run.trial097.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:15.058 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:13:15.062 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:13:15.071 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:15.071 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:13:15.073 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:13:15.079 INFO:teuthology.orchestra.run.trial194.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:13:15.083 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:15.084 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:15.096 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:15.127 INFO:teuthology.orchestra.run.trial078.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:13:15.133 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:13:15.139 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:13:15.141 INFO:teuthology.orchestra.run.trial078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:13:15.146 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:13:15.268 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:15.269 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:15.294 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:15.296 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:13:15.302 INFO:teuthology.orchestra.run.trial078.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:13:15.331 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:15.331 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:13:15.331 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:15.358 INFO:teuthology.orchestra.run.trial194.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:13:15.360 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:15.373 INFO:teuthology.orchestra.run.trial097.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:13:15.375 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:15.376 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:13:15.379 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:13:15.384 INFO:teuthology.orchestra.run.trial194.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:13:15.386 INFO:teuthology.orchestra.run.trial194.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:13:15.387 INFO:teuthology.orchestra.run.trial194.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:15.405 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:15.520 INFO:teuthology.orchestra.run.trial194.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:13:15.522 INFO:teuthology.orchestra.run.trial194.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:15.581 INFO:teuthology.orchestra.run.trial078.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:13:15.582 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:15.597 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:15.601 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:13:15.605 INFO:teuthology.orchestra.run.trial078.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:13:15.608 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:13:15.609 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:15.625 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:15.737 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:13:15.740 INFO:teuthology.orchestra.run.trial078.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:15.803 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:15.803 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:13:15.803 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:15.844 INFO:teuthology.orchestra.run.trial194.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:13:15.846 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:13:16.014 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:16.014 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:13:16.014 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:16.056 INFO:teuthology.orchestra.run.trial078.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:13:16.058 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:13:16.453 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:16.456 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:16.473 INFO:teuthology.orchestra.run.trial114.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:13:16.749 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:16.752 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:16.792 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:16.792 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:13:16.792 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:13:16.792 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:16.795 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:16.924 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:16.927 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:17.134 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:17.136 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:17.221 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:17.225 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:17.264 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:17.264 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:13:17.264 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:13:17.264 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:17.267 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:17.430 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:17.433 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:17.470 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:17.471 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:13:17.471 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:13:17.471 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:17.474 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:17.695 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:17.697 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:17.697 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-18T03:13:17.697 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:17.697 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:13:17.697 INFO:teuthology.orchestra.run.trial114.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout:Upgrading: 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:13:17.698 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:13:17.699 INFO:teuthology.orchestra.run.trial114.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:13:17.700 INFO:teuthology.orchestra.run.trial114.stdout:Installing weak dependencies: 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout:Install 35 Packages 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout:Upgrade 2 Packages 2026-02-18T03:13:17.701 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:17.702 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 79 M 2026-02-18T03:13:17.702 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:13:17.752 INFO:teuthology.orchestra.run.trial031.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:13:18.280 INFO:teuthology.orchestra.run.trial114.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 15 MB/s | 5.9 MB 00:00 2026-02-18T03:13:18.318 INFO:teuthology.orchestra.run.trial114.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 662 kB/s | 25 kB 00:00 2026-02-18T03:13:18.359 INFO:teuthology.orchestra.run.trial114.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 872 kB/s | 35 kB 00:00 2026-02-18T03:13:18.402 INFO:teuthology.orchestra.run.trial114.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 562 kB/s | 24 kB 00:00 2026-02-18T03:13:18.463 INFO:teuthology.orchestra.run.trial114.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 14 MB/s | 869 kB 00:00 2026-02-18T03:13:18.486 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-18T03:13:18.515 INFO:teuthology.orchestra.run.trial114.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 4.7 MB/s | 250 kB 00:00 2026-02-18T03:13:18.739 INFO:teuthology.orchestra.run.trial114.stdout:(7/37): ceph-radosgw-20.2.0-670.gadc19233.el9.x 28 MB/s | 24 MB 00:00 2026-02-18T03:13:18.766 INFO:teuthology.orchestra.run.trial114.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.6 MB/s | 45 kB 00:00 2026-02-18T03:13:18.794 INFO:teuthology.orchestra.run.trial114.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 6.1 MB/s | 175 kB 00:00 2026-02-18T03:13:18.809 INFO:teuthology.orchestra.run.trial114.stdout:(10/37): librgw2-20.2.0-670.gadc19233.el9.x86_6 22 MB/s | 6.4 MB 00:00 2026-02-18T03:13:18.811 INFO:teuthology.orchestra.run.trial114.stdout:(11/37): python3-cephfs-20.2.0-670.gadc19233.el 9.1 MB/s | 162 kB 00:00 2026-02-18T03:13:18.826 INFO:teuthology.orchestra.run.trial114.stdout:(12/37): python3-rados-20.2.0-670.gadc19233.el9 18 MB/s | 323 kB 00:00 2026-02-18T03:13:18.832 INFO:teuthology.orchestra.run.trial114.stdout:(13/37): python3-rbd-20.2.0-670.gadc19233.el9.x 14 MB/s | 305 kB 00:00 2026-02-18T03:13:18.842 INFO:teuthology.orchestra.run.trial114.stdout:(14/37): python3-rgw-20.2.0-670.gadc19233.el9.x 6.0 MB/s | 99 kB 00:00 2026-02-18T03:13:18.915 INFO:teuthology.orchestra.run.trial114.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 401 kB/s | 33 kB 00:00 2026-02-18T03:13:18.967 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:13:18.969 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:18.969 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repository Size 2026-02-18T03:13:18.969 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:18.969 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:13:18.969 INFO:teuthology.orchestra.run.trial031.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:18.969 INFO:teuthology.orchestra.run.trial031.stdout:Upgrading: 2026-02-18T03:13:18.969 INFO:teuthology.orchestra.run.trial031.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:13:18.969 INFO:teuthology.orchestra.run.trial031.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:13:18.970 INFO:teuthology.orchestra.run.trial031.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:13:18.971 INFO:teuthology.orchestra.run.trial031.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout:Installing weak dependencies: 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:13:18.972 INFO:teuthology.orchestra.run.trial031.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:13:18.973 INFO:teuthology.orchestra.run.trial031.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:13:18.973 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:18.973 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:13:18.973 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:18.973 INFO:teuthology.orchestra.run.trial031.stdout:Install 35 Packages 2026-02-18T03:13:18.973 INFO:teuthology.orchestra.run.trial031.stdout:Upgrade 2 Packages 2026-02-18T03:13:18.973 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:18.974 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 79 M 2026-02-18T03:13:18.974 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:13:18.987 INFO:teuthology.orchestra.run.trial114.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 1.3 MB/s | 93 kB 00:00 2026-02-18T03:13:19.025 INFO:teuthology.orchestra.run.trial114.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 2.6 MB/s | 104 kB 00:00 2026-02-18T03:13:19.042 INFO:teuthology.orchestra.run.trial114.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 9.7 MB/s | 164 kB 00:00 2026-02-18T03:13:19.050 INFO:teuthology.orchestra.run.trial114.stdout:(19/37): nvme-cli-2.13-1.el9.x86_64.rpm 5.3 MB/s | 1.1 MB 00:00 2026-02-18T03:13:19.053 INFO:teuthology.orchestra.run.trial114.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 14 MB/s | 160 kB 00:00 2026-02-18T03:13:19.074 INFO:teuthology.orchestra.run.trial114.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 31 MB/s | 662 kB 00:00 2026-02-18T03:13:19.108 INFO:teuthology.orchestra.run.trial114.stdout:(22/37): ceph-common-20.2.0-670.gadc19233.el9.x 20 MB/s | 24 MB 00:01 2026-02-18T03:13:19.108 INFO:teuthology.orchestra.run.trial114.stdout:(23/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 785 kB/s | 45 kB 00:00 2026-02-18T03:13:19.109 INFO:teuthology.orchestra.run.trial114.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.1 MB/s | 292 kB 00:00 2026-02-18T03:13:19.118 INFO:teuthology.orchestra.run.trial114.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 3.7 MB/s | 37 kB 00:00 2026-02-18T03:13:19.119 INFO:teuthology.orchestra.run.trial114.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.0 MB/s | 66 kB 00:00 2026-02-18T03:13:19.153 INFO:teuthology.orchestra.run.trial114.stdout:(27/37): qatlib-25.08.0-2.el9.x86_64.rpm 5.1 MB/s | 240 kB 00:00 2026-02-18T03:13:19.372 INFO:teuthology.orchestra.run.trial114.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 113 kB/s | 25 kB 00:00 2026-02-18T03:13:19.519 INFO:teuthology.orchestra.run.trial114.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 331 kB/s | 49 kB 00:00 2026-02-18T03:13:19.572 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 20 kB 00:00 2026-02-18T03:13:19.587 INFO:teuthology.orchestra.run.trial114.stdout:(30/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 656 kB/s | 308 kB 00:00 2026-02-18T03:13:19.628 INFO:teuthology.orchestra.run.trial114.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 619 kB/s | 67 kB 00:00 2026-02-18T03:13:19.798 INFO:teuthology.orchestra.run.trial114.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2026-02-18T03:13:19.803 INFO:teuthology.orchestra.run.trial114.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2026-02-18T03:13:19.836 INFO:teuthology.orchestra.run.trial114.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2026-02-18T03:13:19.966 INFO:teuthology.orchestra.run.trial114.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2026-02-18T03:13:20.149 INFO:teuthology.orchestra.run.trial031.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 13 MB/s | 5.9 MB 00:00 2026-02-18T03:13:20.191 INFO:teuthology.orchestra.run.trial031.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 601 kB/s | 25 kB 00:00 2026-02-18T03:13:20.195 INFO:teuthology.orchestra.run.trial114.stdout:(36/37): librados2-20.2.0-670.gadc19233.el9.x86 9.0 MB/s | 3.5 MB 00:00 2026-02-18T03:13:20.223 INFO:teuthology.orchestra.run.trial031.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 1.1 MB/s | 35 kB 00:00 2026-02-18T03:13:20.255 INFO:teuthology.orchestra.run.trial031.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 760 kB/s | 24 kB 00:00 2026-02-18T03:13:20.327 INFO:teuthology.orchestra.run.trial114.stdout:(37/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 5.8 MB/s | 2.8 MB 00:00 2026-02-18T03:13:20.328 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:20.329 INFO:teuthology.orchestra.run.trial114.stdout:Total 30 MB/s | 79 MB 00:02 2026-02-18T03:13:20.329 INFO:teuthology.orchestra.run.trial031.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 11 MB/s | 869 kB 00:00 2026-02-18T03:13:20.362 INFO:teuthology.orchestra.run.trial031.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 7.6 MB/s | 250 kB 00:00 2026-02-18T03:13:20.425 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:13:20.444 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:13:20.444 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:13:20.681 INFO:teuthology.orchestra.run.trial031.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 20 MB/s | 6.4 MB 00:00 2026-02-18T03:13:20.708 INFO:teuthology.orchestra.run.trial031.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.7 MB/s | 45 kB 00:00 2026-02-18T03:13:20.738 INFO:teuthology.orchestra.run.trial031.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 5.5 MB/s | 175 kB 00:00 2026-02-18T03:13:20.740 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:13:20.740 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:13:20.743 INFO:teuthology.orchestra.run.trial119.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-18T03:13:20.768 INFO:teuthology.orchestra.run.trial031.stdout:(10/37): python3-cephfs-20.2.0-670.gadc19233.el 5.4 MB/s | 162 kB 00:00 2026-02-18T03:13:20.801 INFO:teuthology.orchestra.run.trial031.stdout:(11/37): python3-rados-20.2.0-670.gadc19233.el9 9.6 MB/s | 323 kB 00:00 2026-02-18T03:13:20.833 INFO:teuthology.orchestra.run.trial031.stdout:(12/37): python3-rbd-20.2.0-670.gadc19233.el9.x 9.3 MB/s | 305 kB 00:00 2026-02-18T03:13:20.863 INFO:teuthology.orchestra.run.trial031.stdout:(13/37): python3-rgw-20.2.0-670.gadc19233.el9.x 3.3 MB/s | 99 kB 00:00 2026-02-18T03:13:20.919 INFO:teuthology.orchestra.run.trial031.stdout:(14/37): ceph-common-20.2.0-670.gadc19233.el9.x 20 MB/s | 24 MB 00:01 2026-02-18T03:13:21.007 INFO:teuthology.orchestra.run.trial031.stdout:(15/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 18 MB/s | 24 MB 00:01 2026-02-18T03:13:21.078 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:13:21.090 INFO:teuthology.orchestra.run.trial114.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:13:21.246 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:13:21.251 INFO:teuthology.orchestra.run.trial114.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:21.302 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:21.303 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:21.315 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:21.318 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:21.318 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /sys 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /proc 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /mnt 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /var/tmp 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /home 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /root 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /tmp 2026-02-18T03:13:21.342 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:21.346 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:21.348 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:21.353 INFO:teuthology.orchestra.run.trial031.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 68 kB/s | 33 kB 00:00 2026-02-18T03:13:21.357 INFO:teuthology.orchestra.run.trial114.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:13:21.360 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:13:21.363 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:13:21.367 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:13:21.376 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:13:21.387 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:21.388 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:21.402 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:21.433 INFO:teuthology.orchestra.run.trial114.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:13:21.438 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:13:21.445 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:13:21.447 INFO:teuthology.orchestra.run.trial114.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:13:21.452 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:13:21.577 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:21.578 INFO:teuthology.orchestra.run.trial114.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:21.600 INFO:teuthology.orchestra.run.trial031.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 157 kB/s | 93 kB 00:00 2026-02-18T03:13:21.603 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:21.606 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:13:21.612 INFO:teuthology.orchestra.run.trial114.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:13:21.618 INFO:teuthology.orchestra.run.trial031.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 392 kB/s | 104 kB 00:00 2026-02-18T03:13:21.801 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:21.802 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /sys 2026-02-18T03:13:21.802 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /proc 2026-02-18T03:13:21.802 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /mnt 2026-02-18T03:13:21.802 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /var/tmp 2026-02-18T03:13:21.802 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /home 2026-02-18T03:13:21.802 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /root 2026-02-18T03:13:21.802 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /tmp 2026-02-18T03:13:21.802 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:21.860 INFO:teuthology.orchestra.run.trial031.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 630 kB/s | 164 kB 00:00 2026-02-18T03:13:21.881 INFO:teuthology.orchestra.run.trial031.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 609 kB/s | 160 kB 00:00 2026-02-18T03:13:21.897 INFO:teuthology.orchestra.run.trial114.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:13:21.898 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:21.915 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:21.920 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:13:21.925 INFO:teuthology.orchestra.run.trial114.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:13:21.927 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:13:21.928 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:21.946 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:21.962 INFO:teuthology.orchestra.run.trial031.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 444 kB/s | 45 kB 00:00 2026-02-18T03:13:22.023 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:22.023 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /sys 2026-02-18T03:13:22.023 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /proc 2026-02-18T03:13:22.024 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /mnt 2026-02-18T03:13:22.024 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /var/tmp 2026-02-18T03:13:22.024 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /home 2026-02-18T03:13:22.024 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /root 2026-02-18T03:13:22.024 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /tmp 2026-02-18T03:13:22.024 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:22.058 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:13:22.060 INFO:teuthology.orchestra.run.trial114.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:22.337 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:22.337 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:13:22.337 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:22.366 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:22.379 INFO:teuthology.orchestra.run.trial114.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:13:22.381 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:13:22.389 INFO:teuthology.orchestra.run.trial031.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 686 kB/s | 292 kB 00:00 2026-02-18T03:13:22.389 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:22.389 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:22.389 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:13:22.389 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:22.390 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:22.390 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:22.391 INFO:teuthology.orchestra.run.trial097.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:22.403 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:22.404 INFO:teuthology.orchestra.run.trial097.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:22.460 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:22.460 INFO:teuthology.orchestra.run.trial097.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:13:22.460 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:22.633 INFO:teuthology.orchestra.run.trial031.stdout:(23/37): nvme-cli-2.13-1.el9.x86_64.rpm 656 kB/s | 1.1 MB 00:01 2026-02-18T03:13:22.708 INFO:teuthology.orchestra.run.trial031.stdout:(24/37): librdkafka-1.6.1-102.el9.x86_64.rpm 801 kB/s | 662 kB 00:00 2026-02-18T03:13:22.731 INFO:teuthology.orchestra.run.trial031.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 376 kB/s | 37 kB 00:00 2026-02-18T03:13:22.734 INFO:teuthology.orchestra.run.trial031.stdout:(26/37): qatlib-25.08.0-2.el9.x86_64.rpm 693 kB/s | 240 kB 00:00 2026-02-18T03:13:22.776 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:13:22.776 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:22.777 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:13:22.778 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:13:22.779 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:13:22.810 INFO:teuthology.orchestra.run.trial031.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 649 kB/s | 66 kB 00:00 2026-02-18T03:13:22.832 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:22.832 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout:Upgraded: 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.833 INFO:teuthology.orchestra.run.trial097.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:13:22.834 INFO:teuthology.orchestra.run.trial097.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.835 INFO:teuthology.orchestra.run.trial097.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:22.836 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:22.856 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:22.856 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:22.856 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:13:22.856 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:22.856 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:22.856 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:22.858 INFO:teuthology.orchestra.run.trial194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:22.870 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:22.871 INFO:teuthology.orchestra.run.trial194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:22.877 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-test 2026-02-18T03:13:22.926 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:22.927 INFO:teuthology.orchestra.run.trial194.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:13:22.927 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:22.998 INFO:teuthology.orchestra.run.trial031.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 132 kB/s | 25 kB 00:00 2026-02-18T03:13:23.054 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:23.062 INFO:teuthology.orchestra.run.trial031.stdout:(29/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 931 kB/s | 308 kB 00:00 2026-02-18T03:13:23.078 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:23.078 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:23.078 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:13:23.078 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:23.079 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:23.079 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:23.080 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:23.087 INFO:teuthology.orchestra.run.trial031.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 549 kB/s | 49 kB 00:00 2026-02-18T03:13:23.092 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:23.092 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:23.111 INFO:teuthology.orchestra.run.trial031.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2026-02-18T03:13:23.148 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:23.148 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:13:23.149 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:23.171 INFO:teuthology.orchestra.run.trial031.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 3.1 MB/s | 191 kB 00:00 2026-02-18T03:13:23.185 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:15 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:23.238 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:13:23.238 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:13:23.238 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:23.238 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:23.238 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:13:23.239 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:13:23.240 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:13:23.241 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:13:23.254 INFO:teuthology.orchestra.run.trial031.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2026-02-18T03:13:23.266 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:23.266 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:23.266 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repository Size 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:23.267 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:23.268 INFO:teuthology.orchestra.run.trial097.stdout:Install 5 Packages 2026-02-18T03:13:23.268 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:23.268 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 85 M 2026-02-18T03:13:23.268 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 364 M 2026-02-18T03:13:23.269 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:23.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:23.294 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout:Upgraded: 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.295 INFO:teuthology.orchestra.run.trial194.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.296 INFO:teuthology.orchestra.run.trial194.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.297 INFO:teuthology.orchestra.run.trial194.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.298 INFO:teuthology.orchestra.run.trial194.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.298 INFO:teuthology.orchestra.run.trial194.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:13:23.298 INFO:teuthology.orchestra.run.trial194.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:13:23.298 INFO:teuthology.orchestra.run.trial194.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:13:23.298 INFO:teuthology.orchestra.run.trial194.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:13:23.298 INFO:teuthology.orchestra.run.trial194.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:13:23.298 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:23.298 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:23.303 INFO:teuthology.orchestra.run.trial031.stdout:(34/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.8 MB/s | 838 kB 00:00 2026-02-18T03:13:23.335 INFO:teuthology.orchestra.run.trial031.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 9.7 MB/s | 1.6 MB 00:00 2026-02-18T03:13:23.337 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-test 2026-02-18T03:13:23.359 INFO:teuthology.orchestra.run.trial097.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 8.6 MB/s | 233 kB 00:00 2026-02-18T03:13:23.372 INFO:teuthology.orchestra.run.trial097.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 24 MB/s | 303 kB 00:00 2026-02-18T03:13:23.377 INFO:teuthology.orchestra.run.trial097.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-18T03:13:23.387 INFO:teuthology.orchestra.run.trial031.stdout:(36/37): librados2-20.2.0-670.gadc19233.el9.x86 27 MB/s | 3.5 MB 00:00 2026-02-18T03:13:23.430 INFO:teuthology.orchestra.run.trial097.stdout:(4/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 1.7 MB/s | 164 kB 00:00 2026-02-18T03:13:23.430 INFO:teuthology.orchestra.run.trial031.stdout:(37/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 22 MB/s | 2.8 MB 00:00 2026-02-18T03:13:23.435 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:23.435 INFO:teuthology.orchestra.run.trial031.stdout:Total 18 MB/s | 79 MB 00:04 2026-02-18T03:13:23.468 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:13:23.468 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:13:23.468 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:23.468 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:23.468 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:23.468 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:23.468 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:23.468 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:23.469 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:13:23.470 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:13:23.471 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:13:23.471 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:13:23.471 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:23.471 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:13:23.471 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:13:23.483 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:23.485 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:23.523 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:23.523 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:23.523 INFO:teuthology.orchestra.run.trial078.stdout:Upgraded: 2026-02-18T03:13:23.523 INFO:teuthology.orchestra.run.trial078.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.523 INFO:teuthology.orchestra.run.trial078.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.523 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.524 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:13:23.525 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:13:23.526 INFO:teuthology.orchestra.run.trial078.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:13:23.527 INFO:teuthology.orchestra.run.trial078.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:13:23.527 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:23.527 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:23.530 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:13:23.549 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:13:23.549 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:13:23.566 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-test 2026-02-18T03:13:23.648 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:17 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:23.728 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:23.729 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:23.729 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-18T03:13:23.729 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:23.730 INFO:teuthology.orchestra.run.trial194.stdout:Install 5 Packages 2026-02-18T03:13:23.731 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:23.731 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 85 M 2026-02-18T03:13:23.731 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 364 M 2026-02-18T03:13:23.731 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:23.787 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:23.791 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:23.835 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:23.835 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:13:23.835 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:13:23.835 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:23.839 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:23.849 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:13:23.849 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:13:23.877 INFO:teuthology.orchestra.run.trial119.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-18T03:13:23.878 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:13 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:23.961 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:13:23.962 INFO:teuthology.orchestra.run.trial078.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout:Install 5 Packages 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 85 M 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 364 M 2026-02-18T03:13:23.963 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:24.154 INFO:teuthology.orchestra.run.trial194.stdout:(1/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 449 kB/s | 164 kB 00:00 2026-02-18T03:13:24.192 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:13:24.203 INFO:teuthology.orchestra.run.trial031.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:13:24.369 INFO:teuthology.orchestra.run.trial031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:13:24.374 INFO:teuthology.orchestra.run.trial031.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:24.424 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:24.426 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:24.438 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:24.440 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:24.441 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:24.468 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:24.471 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:24.478 INFO:teuthology.orchestra.run.trial031.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:13:24.481 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:13:24.484 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:13:24.488 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:13:24.497 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:13:24.508 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:24.509 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:24.522 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:24.554 INFO:teuthology.orchestra.run.trial031.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:13:24.558 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:13:24.564 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:13:24.567 INFO:teuthology.orchestra.run.trial031.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:13:24.571 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:13:24.574 INFO:teuthology.orchestra.run.trial078.stdout:(1/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 302 kB/s | 164 kB 00:00 2026-02-18T03:13:24.701 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:24.702 INFO:teuthology.orchestra.run.trial031.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:24.728 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:24.731 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:13:24.731 INFO:teuthology.orchestra.run.trial194.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 247 kB/s | 233 kB 00:00 2026-02-18T03:13:24.739 INFO:teuthology.orchestra.run.trial031.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:13:24.900 INFO:teuthology.orchestra.run.trial078.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 268 kB/s | 233 kB 00:00 2026-02-18T03:13:24.968 INFO:teuthology.orchestra.run.trial194.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 269 kB/s | 64 kB 00:00 2026-02-18T03:13:25.030 INFO:teuthology.orchestra.run.trial031.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:13:25.031 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:25.036 INFO:teuthology.orchestra.run.trial194.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 344 kB/s | 303 kB 00:00 2026-02-18T03:13:25.047 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:25.051 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:13:25.057 INFO:teuthology.orchestra.run.trial031.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:13:25.057 INFO:teuthology.orchestra.run.trial078.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 404 kB/s | 64 kB 00:00 2026-02-18T03:13:25.059 INFO:teuthology.orchestra.run.trial031.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:13:25.060 INFO:teuthology.orchestra.run.trial031.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:25.078 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:25.102 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:13:25.104 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:13:25.104 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repository Size 2026-02-18T03:13:25.104 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:13:25.104 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:13:25.104 INFO:teuthology.orchestra.run.trial119.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:25.104 INFO:teuthology.orchestra.run.trial119.stdout:Upgrading: 2026-02-18T03:13:25.104 INFO:teuthology.orchestra.run.trial119.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:13:25.104 INFO:teuthology.orchestra.run.trial119.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:13:25.105 INFO:teuthology.orchestra.run.trial119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:13:25.106 INFO:teuthology.orchestra.run.trial119.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout:Installing weak dependencies: 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:13:25.107 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:25.108 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:13:25.108 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:13:25.108 INFO:teuthology.orchestra.run.trial119.stdout:Install 35 Packages 2026-02-18T03:13:25.108 INFO:teuthology.orchestra.run.trial119.stdout:Upgrade 2 Packages 2026-02-18T03:13:25.108 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:25.109 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 79 M 2026-02-18T03:13:25.109 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:13:25.192 INFO:teuthology.orchestra.run.trial031.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:13:25.194 INFO:teuthology.orchestra.run.trial031.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:25.474 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:25.474 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:13:25.474 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:25.516 INFO:teuthology.orchestra.run.trial078.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 322 kB/s | 303 kB 00:00 2026-02-18T03:13:25.519 INFO:teuthology.orchestra.run.trial031.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:13:25.521 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:13:25.775 INFO:teuthology.orchestra.run.trial097.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 34 MB/s | 84 MB 00:02 2026-02-18T03:13:25.776 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:25.777 INFO:teuthology.orchestra.run.trial097.stdout:Total 34 MB/s | 85 MB 00:02 2026-02-18T03:13:25.803 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:25.812 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:25.812 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:26.101 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:26.101 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:26.408 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:26.414 INFO:teuthology.orchestra.run.trial097.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:13:26.418 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:13:26.425 INFO:teuthology.orchestra.run.trial097.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:13:26.426 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:26.661 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:26.664 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:26.757 INFO:teuthology.orchestra.run.trial119.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 5.1 MB/s | 5.9 MB 00:01 2026-02-18T03:13:26.763 INFO:teuthology.orchestra.run.trial194.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 28 MB/s | 84 MB 00:02 2026-02-18T03:13:26.766 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:26.766 INFO:teuthology.orchestra.run.trial194.stdout:Total 28 MB/s | 85 MB 00:03 2026-02-18T03:13:26.779 INFO:teuthology.orchestra.run.trial119.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 1.1 MB/s | 25 kB 00:00 2026-02-18T03:13:26.792 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:26.802 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:26.802 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:26.805 INFO:teuthology.orchestra.run.trial119.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 1.3 MB/s | 35 kB 00:00 2026-02-18T03:13:26.832 INFO:teuthology.orchestra.run.trial119.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 898 kB/s | 24 kB 00:00 2026-02-18T03:13:26.905 INFO:teuthology.orchestra.run.trial119.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 12 MB/s | 869 kB 00:00 2026-02-18T03:13:26.940 INFO:teuthology.orchestra.run.trial119.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 6.9 MB/s | 250 kB 00:00 2026-02-18T03:13:26.970 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:26.973 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:27.010 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:27.011 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:13:27.011 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:13:27.011 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:27.014 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:27.091 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:27.091 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:27.402 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:27.408 INFO:teuthology.orchestra.run.trial194.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:13:27.411 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:13:27.419 INFO:teuthology.orchestra.run.trial194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:13:27.420 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:27.455 INFO:teuthology.orchestra.run.trial119.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 12 MB/s | 6.4 MB 00:00 2026-02-18T03:13:27.508 INFO:teuthology.orchestra.run.trial119.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 844 kB/s | 45 kB 00:00 2026-02-18T03:13:27.566 INFO:teuthology.orchestra.run.trial119.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 2.9 MB/s | 175 kB 00:00 2026-02-18T03:13:27.627 INFO:teuthology.orchestra.run.trial119.stdout:(10/37): python3-cephfs-20.2.0-670.gadc19233.el 2.6 MB/s | 162 kB 00:00 2026-02-18T03:13:27.694 INFO:teuthology.orchestra.run.trial119.stdout:(11/37): python3-rados-20.2.0-670.gadc19233.el9 4.7 MB/s | 323 kB 00:00 2026-02-18T03:13:27.772 INFO:teuthology.orchestra.run.trial119.stdout:(12/37): ceph-common-20.2.0-670.gadc19233.el9.x 11 MB/s | 24 MB 00:02 2026-02-18T03:13:27.774 INFO:teuthology.orchestra.run.trial119.stdout:(13/37): python3-rbd-20.2.0-670.gadc19233.el9.x 3.7 MB/s | 305 kB 00:00 2026-02-18T03:13:27.817 INFO:teuthology.orchestra.run.trial119.stdout:(14/37): python3-rgw-20.2.0-670.gadc19233.el9.x 2.2 MB/s | 99 kB 00:00 2026-02-18T03:13:28.177 INFO:teuthology.orchestra.run.trial119.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 82 kB/s | 33 kB 00:00 2026-02-18T03:13:28.347 INFO:teuthology.orchestra.run.trial119.stdout:(16/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 8.6 MB/s | 24 MB 00:02 2026-02-18T03:13:28.376 INFO:teuthology.orchestra.run.trial119.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 466 kB/s | 93 kB 00:00 2026-02-18T03:13:28.386 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:28.386 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /sys 2026-02-18T03:13:28.386 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /proc 2026-02-18T03:13:28.386 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /mnt 2026-02-18T03:13:28.386 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /var/tmp 2026-02-18T03:13:28.386 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /home 2026-02-18T03:13:28.387 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /root 2026-02-18T03:13:28.387 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /tmp 2026-02-18T03:13:28.387 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:28.543 INFO:teuthology.orchestra.run.trial119.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 532 kB/s | 104 kB 00:00 2026-02-18T03:13:28.796 INFO:teuthology.orchestra.run.trial119.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 632 kB/s | 160 kB 00:00 2026-02-18T03:13:28.895 INFO:teuthology.orchestra.run.trial119.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 457 kB/s | 45 kB 00:00 2026-02-18T03:13:28.912 INFO:teuthology.orchestra.run.trial078.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 17 MB/s | 84 MB 00:04 2026-02-18T03:13:28.915 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:28.915 INFO:teuthology.orchestra.run.trial078.stdout:Total 17 MB/s | 85 MB 00:04 2026-02-18T03:13:28.941 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:28.951 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:28.951 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:29.052 INFO:teuthology.orchestra.run.trial119.stdout:(21/37): libnbd-1.20.3-4.el9.x86_64.rpm 243 kB/s | 164 kB 00:00 2026-02-18T03:13:29.242 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:29.243 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:29.429 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:29.453 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:29.453 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:29.453 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:13:29.453 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:29.453 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:29.453 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:29.454 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:29.466 INFO:teuthology.orchestra.run.trial119.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 706 kB/s | 292 kB 00:00 2026-02-18T03:13:29.467 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:29.467 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:29.480 INFO:teuthology.orchestra.run.trial119.stdout:(23/37): nvme-cli-2.13-1.el9.x86_64.rpm 675 kB/s | 1.1 MB 00:01 2026-02-18T03:13:29.521 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:29.522 INFO:teuthology.orchestra.run.trial114.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:13:29.522 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:29.554 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:29.560 INFO:teuthology.orchestra.run.trial078.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:13:29.564 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:13:29.572 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:13:29.573 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:29.580 INFO:teuthology.orchestra.run.trial119.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 373 kB/s | 37 kB 00:00 2026-02-18T03:13:29.679 INFO:teuthology.orchestra.run.trial119.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 667 kB/s | 66 kB 00:00 2026-02-18T03:13:29.694 INFO:teuthology.orchestra.run.trial119.stdout:(26/37): librdkafka-1.6.1-102.el9.x86_64.rpm 829 kB/s | 662 kB 00:00 2026-02-18T03:13:29.802 INFO:teuthology.orchestra.run.trial119.stdout:(27/37): qatlib-25.08.0-2.el9.x86_64.rpm 714 kB/s | 240 kB 00:00 2026-02-18T03:13:29.845 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:13:29.846 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:13:29.847 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:13:29.848 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:29.849 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:13:29.849 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:13:29.901 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:29.901 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:29.901 INFO:teuthology.orchestra.run.trial114.stdout:Upgraded: 2026-02-18T03:13:29.901 INFO:teuthology.orchestra.run.trial114.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.901 INFO:teuthology.orchestra.run.trial114.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.902 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:13:29.903 INFO:teuthology.orchestra.run.trial114.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:13:29.904 INFO:teuthology.orchestra.run.trial114.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:13:29.905 INFO:teuthology.orchestra.run.trial114.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:13:29.905 INFO:teuthology.orchestra.run.trial114.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:13:29.905 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:29.905 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:29.905 INFO:teuthology.orchestra.run.trial119.stdout:(28/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.3 MB/s | 308 kB 00:00 2026-02-18T03:13:29.906 INFO:teuthology.orchestra.run.trial119.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 241 kB/s | 25 kB 00:00 2026-02-18T03:13:29.938 INFO:teuthology.orchestra.run.trial119.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 1.3 MB/s | 49 kB 00:00 2026-02-18T03:13:29.943 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-test 2026-02-18T03:13:29.989 INFO:teuthology.orchestra.run.trial119.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 799 kB/s | 67 kB 00:00 2026-02-18T03:13:30.034 INFO:teuthology.orchestra.run.trial119.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.5 MB/s | 838 kB 00:00 2026-02-18T03:13:30.039 INFO:teuthology.orchestra.run.trial119.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2026-02-18T03:13:30.078 INFO:teuthology.orchestra.run.trial119.stdout:(34/37): re2-20211101-20.el9.x86_64.rpm 2.1 MB/s | 191 kB 00:00 2026-02-18T03:13:30.117 INFO:teuthology.orchestra.run.trial119.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2026-02-18T03:13:30.145 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:30.162 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:30.170 INFO:teuthology.orchestra.run.trial119.stdout:(36/37): librados2-20.2.0-670.gadc19233.el9.x86 27 MB/s | 3.5 MB 00:00 2026-02-18T03:13:30.204 INFO:teuthology.orchestra.run.trial119.stdout:(37/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 23 MB/s | 2.8 MB 00:00 2026-02-18T03:13:30.207 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:30.207 INFO:teuthology.orchestra.run.trial119.stdout:Total 15 MB/s | 79 MB 00:05 2026-02-18T03:13:30.256 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:14 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:30.301 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:13:30.320 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:13:30.320 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:13:30.337 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:30.338 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:30.338 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:13:30.339 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:30.340 INFO:teuthology.orchestra.run.trial114.stdout:Install 5 Packages 2026-02-18T03:13:30.340 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:30.340 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 85 M 2026-02-18T03:13:30.340 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 364 M 2026-02-18T03:13:30.340 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:13:30.510 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:30.510 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:13:30.510 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:13:30.510 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:13:30.510 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:13:30.561 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:13:30.561 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:30.562 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:30.562 INFO:teuthology.orchestra.run.trial097.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:30.562 INFO:teuthology.orchestra.run.trial097.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:30.562 INFO:teuthology.orchestra.run.trial097.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:13:30.562 INFO:teuthology.orchestra.run.trial097.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:13:30.562 INFO:teuthology.orchestra.run.trial097.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:13:30.562 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:30.562 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:30.599 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph 2026-02-18T03:13:30.616 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:13:30.617 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:13:30.697 INFO:teuthology.orchestra.run.trial114.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.2 MB/s | 233 kB 00:00 2026-02-18T03:13:30.715 INFO:teuthology.orchestra.run.trial114.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 16 MB/s | 303 kB 00:00 2026-02-18T03:13:30.724 INFO:teuthology.orchestra.run.trial114.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.0 MB/s | 64 kB 00:00 2026-02-18T03:13:30.727 INFO:teuthology.orchestra.run.trial114.stdout:(4/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 1.9 MB/s | 164 kB 00:00 2026-02-18T03:13:30.906 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:22 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:30.963 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:13:30.974 INFO:teuthology.orchestra.run.trial119.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:13:30.991 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:30.994 INFO:teuthology.orchestra.run.trial097.stdout:====================================================================================== 2026-02-18T03:13:30.994 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repository Size 2026-02-18T03:13:30.994 INFO:teuthology.orchestra.run.trial097.stdout:====================================================================================== 2026-02-18T03:13:30.994 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:30.994 INFO:teuthology.orchestra.run.trial097.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:13:30.994 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:13:30.995 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:13:30.996 INFO:teuthology.orchestra.run.trial097.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:13:30.997 INFO:teuthology.orchestra.run.trial097.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:13:30.998 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:13:30.999 INFO:teuthology.orchestra.run.trial097.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:13:31.000 INFO:teuthology.orchestra.run.trial097.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:13:31.001 INFO:teuthology.orchestra.run.trial097.stdout:Installing weak dependencies: 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:31.002 INFO:teuthology.orchestra.run.trial097.stdout:====================================================================================== 2026-02-18T03:13:31.003 INFO:teuthology.orchestra.run.trial097.stdout:Install 95 Packages 2026-02-18T03:13:31.003 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:31.003 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 101 M 2026-02-18T03:13:31.004 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 561 M 2026-02-18T03:13:31.004 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:31.126 INFO:teuthology.orchestra.run.trial119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:13:31.132 INFO:teuthology.orchestra.run.trial119.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:31.181 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:31.182 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:31.194 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:31.196 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:31.197 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:31.224 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:31.227 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:31.234 INFO:teuthology.orchestra.run.trial119.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:13:31.237 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:13:31.240 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:13:31.244 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:13:31.253 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:13:31.264 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:31.265 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:31.278 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:31.286 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:31.304 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:31.308 INFO:teuthology.orchestra.run.trial119.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:13:31.312 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:13:31.319 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:13:31.321 INFO:teuthology.orchestra.run.trial119.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:13:31.326 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:13:31.448 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:31.449 INFO:teuthology.orchestra.run.trial119.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:31.474 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:13:31.476 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:13:31.483 INFO:teuthology.orchestra.run.trial119.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /sys 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /proc 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /mnt 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /var/tmp 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /home 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /root 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /tmp 2026-02-18T03:13:31.549 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:31.638 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:31.638 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:13:31.638 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:13:31.638 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:13:31.638 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:31.690 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:31.728 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph 2026-02-18T03:13:31.751 INFO:teuthology.orchestra.run.trial097.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 33 kB/s | 6.5 kB 00:00 2026-02-18T03:13:31.759 INFO:teuthology.orchestra.run.trial119.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:13:31.760 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:31.776 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:13:31.781 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:13:31.786 INFO:teuthology.orchestra.run.trial119.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:13:31.788 INFO:teuthology.orchestra.run.trial119.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:13:31.789 INFO:teuthology.orchestra.run.trial119.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:31.807 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:13:31.918 INFO:teuthology.orchestra.run.trial119.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:13:31.920 INFO:teuthology.orchestra.run.trial119.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:32.036 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:26 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:32.088 INFO:teuthology.orchestra.run.trial097.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 1.8 MB/s | 961 kB 00:00 2026-02-18T03:13:32.122 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout:====================================================================================== 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout:====================================================================================== 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:13:32.125 INFO:teuthology.orchestra.run.trial194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:13:32.126 INFO:teuthology.orchestra.run.trial194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout:Installing weak dependencies: 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout:====================================================================================== 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout:Install 95 Packages 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 101 M 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 561 M 2026-02-18T03:13:32.127 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:32.198 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:13:32.198 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:13:32.198 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:32.200 INFO:teuthology.orchestra.run.trial097.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 3.6 MB/s | 2.3 MB 00:00 2026-02-18T03:13:32.239 INFO:teuthology.orchestra.run.trial119.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:13:32.242 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:13:32.253 INFO:teuthology.orchestra.run.trial097.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 826 kB/s | 43 kB 00:00 2026-02-18T03:13:32.265 INFO:teuthology.orchestra.run.trial097.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 14 MB/s | 173 kB 00:00 2026-02-18T03:13:32.363 INFO:teuthology.orchestra.run.trial114.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 49 MB/s | 84 MB 00:01 2026-02-18T03:13:32.364 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:32.364 INFO:teuthology.orchestra.run.trial114.stdout:Total 42 MB/s | 85 MB 00:02 2026-02-18T03:13:32.392 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:13:32.401 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:13:32.401 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:13:32.595 INFO:teuthology.orchestra.run.trial097.stdout:(6/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 32 MB/s | 11 MB 00:00 2026-02-18T03:13:32.632 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:32.656 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:32.656 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:32.656 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:13:32.656 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:32.657 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:32.657 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:32.658 INFO:teuthology.orchestra.run.trial031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:32.670 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:32.671 INFO:teuthology.orchestra.run.trial031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:32.688 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:13:32.688 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:13:32.724 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:32.724 INFO:teuthology.orchestra.run.trial031.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:13:32.724 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:32.838 INFO:teuthology.orchestra.run.trial097.stdout:(7/95): ceph-mgr-diskprediction-local-20.2.0-67 31 MB/s | 7.4 MB 00:00 2026-02-18T03:13:32.851 INFO:teuthology.orchestra.run.trial097.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 1.6 MB/s | 22 kB 00:00 2026-02-18T03:13:32.864 INFO:teuthology.orchestra.run.trial194.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 50 kB/s | 6.5 kB 00:00 2026-02-18T03:13:32.878 INFO:teuthology.orchestra.run.trial097.stdout:(9/95): ceph-mgr-modules-core-20.2.0-670.gadc19 11 MB/s | 290 kB 00:00 2026-02-18T03:13:32.903 INFO:teuthology.orchestra.run.trial097.stdout:(10/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 2.0 MB/s | 50 kB 00:00 2026-02-18T03:13:32.947 INFO:teuthology.orchestra.run.trial097.stdout:(11/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 20 MB/s | 17 MB 00:00 2026-02-18T03:13:32.947 INFO:teuthology.orchestra.run.trial097.stdout:(12/95): ceph-prometheus-alerts-20.2.0-670.gadc 391 kB/s | 17 kB 00:00 2026-02-18T03:13:32.964 INFO:teuthology.orchestra.run.trial097.stdout:(13/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_ 4.2 MB/s | 5.1 MB 00:01 2026-02-18T03:13:32.965 INFO:teuthology.orchestra.run.trial097.stdout:(14/95): ceph-volume-20.2.0-670.gadc19233.el9.n 16 MB/s | 297 kB 00:00 2026-02-18T03:13:32.976 INFO:teuthology.orchestra.run.trial097.stdout:(15/95): cephadm-20.2.0-670.gadc19233.el9.noarc 35 MB/s | 1.0 MB 00:00 2026-02-18T03:13:32.997 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:13:33.003 INFO:teuthology.orchestra.run.trial114.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:13:33.007 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:13:33.015 INFO:teuthology.orchestra.run.trial114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:13:33.016 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:33.018 INFO:teuthology.orchestra.run.trial097.stdout:(16/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 6.3 MB/s | 350 kB 00:00 2026-02-18T03:13:33.024 INFO:teuthology.orchestra.run.trial097.stdout:(17/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 684 kB/s | 40 kB 00:00 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:13:33.032 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:13:33.033 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:13:33.033 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:13:33.033 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:33.033 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:13:33.033 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:13:33.036 INFO:teuthology.orchestra.run.trial097.stdout:(18/95): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-02-18T03:13:33.050 INFO:teuthology.orchestra.run.trial097.stdout:(19/95): libgfortran-11.5.0-14.el9.x86_64.rpm 25 MB/s | 794 kB 00:00 2026-02-18T03:13:33.051 INFO:teuthology.orchestra.run.trial097.stdout:(20/95): libquadmath-11.5.0-14.el9.x86_64.rpm 6.8 MB/s | 184 kB 00:00 2026-02-18T03:13:33.059 INFO:teuthology.orchestra.run.trial097.stdout:(21/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 11 MB/s | 253 kB 00:00 2026-02-18T03:13:33.073 INFO:teuthology.orchestra.run.trial194.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 2.8 MB/s | 961 kB 00:00 2026-02-18T03:13:33.077 INFO:teuthology.orchestra.run.trial097.stdout:(22/95): python3-cryptography-36.0.1-5.el9.x86_ 46 MB/s | 1.2 MB 00:00 2026-02-18T03:13:33.078 INFO:teuthology.orchestra.run.trial097.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 6.8 MB/s | 135 kB 00:00 2026-02-18T03:13:33.089 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:33.089 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout:Upgraded: 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.090 INFO:teuthology.orchestra.run.trial031.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:13:33.091 INFO:teuthology.orchestra.run.trial031.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.092 INFO:teuthology.orchestra.run.trial031.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.093 INFO:teuthology.orchestra.run.trial031.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:13:33.093 INFO:teuthology.orchestra.run.trial031.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:13:33.093 INFO:teuthology.orchestra.run.trial031.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:13:33.093 INFO:teuthology.orchestra.run.trial031.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:13:33.093 INFO:teuthology.orchestra.run.trial031.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:13:33.093 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:33.093 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:13:33.094 INFO:teuthology.orchestra.run.trial097.stdout:(24/95): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 106 kB 00:00 2026-02-18T03:13:33.102 INFO:teuthology.orchestra.run.trial097.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 5.2 MB/s | 126 kB 00:00 2026-02-18T03:13:33.104 INFO:teuthology.orchestra.run.trial097.stdout:(26/95): python3-pyparsing-2.4.7-9.el9.noarch.r 5.6 MB/s | 150 kB 00:00 2026-02-18T03:13:33.122 INFO:teuthology.orchestra.run.trial097.stdout:(27/95): python3-urllib3-1.26.5-7.el9.noarch.rp 7.6 MB/s | 218 kB 00:00 2026-02-18T03:13:33.126 INFO:teuthology.orchestra.run.trial097.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 12 MB/s | 266 kB 00:00 2026-02-18T03:13:33.131 INFO:teuthology.orchestra.run.trial097.stdout:(29/95): unzip-6.0-59.el9.x86_64.rpm 6.3 MB/s | 182 kB 00:00 2026-02-18T03:13:33.133 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-test 2026-02-18T03:13:33.134 INFO:teuthology.orchestra.run.trial097.stdout:(30/95): flexiblas-3.0.4-9.el9.x86_64.rpm 2.5 MB/s | 30 kB 00:00 2026-02-18T03:13:33.141 INFO:teuthology.orchestra.run.trial097.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 1.5 MB/s | 15 kB 00:00 2026-02-18T03:13:33.150 INFO:teuthology.orchestra.run.trial097.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 15 MB/s | 246 kB 00:00 2026-02-18T03:13:33.153 INFO:teuthology.orchestra.run.trial097.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 16 MB/s | 188 kB 00:00 2026-02-18T03:13:33.154 INFO:teuthology.orchestra.run.trial097.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 9.2 MB/s | 42 kB 00:00 2026-02-18T03:13:33.166 INFO:teuthology.orchestra.run.trial097.stdout:(35/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 76 MB/s | 3.0 MB 00:00 2026-02-18T03:13:33.186 INFO:teuthology.orchestra.run.trial097.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 32 MB/s | 1.0 MB 00:00 2026-02-18T03:13:33.192 INFO:teuthology.orchestra.run.trial194.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 5.1 MB/s | 2.3 MB 00:00 2026-02-18T03:13:33.198 INFO:teuthology.orchestra.run.trial097.stdout:(37/95): python3-babel-2.9.1-2.el9.noarch.rpm 187 MB/s | 6.0 MB 00:00 2026-02-18T03:13:33.199 INFO:teuthology.orchestra.run.trial097.stdout:(38/95): python3-devel-3.9.25-2.el9.x86_64.rpm 18 MB/s | 244 kB 00:00 2026-02-18T03:13:33.203 INFO:teuthology.orchestra.run.trial194.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 3.7 MB/s | 43 kB 00:00 2026-02-18T03:13:33.205 INFO:teuthology.orchestra.run.trial097.stdout:(39/95): python3-jmespath-1.0.1-1.el9.noarch.rp 7.5 MB/s | 48 kB 00:00 2026-02-18T03:13:33.207 INFO:teuthology.orchestra.run.trial097.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 27 MB/s | 249 kB 00:00 2026-02-18T03:13:33.214 INFO:teuthology.orchestra.run.trial097.stdout:(41/95): python3-libstoragemgmt-1.10.1-1.el9.x8 21 MB/s | 177 kB 00:00 2026-02-18T03:13:33.218 INFO:teuthology.orchestra.run.trial097.stdout:(42/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 118 MB/s | 1.2 MB 00:00 2026-02-18T03:13:33.219 INFO:teuthology.orchestra.run.trial097.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 6.3 MB/s | 35 kB 00:00 2026-02-18T03:13:33.225 INFO:teuthology.orchestra.run.trial194.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 7.7 MB/s | 173 kB 00:00 2026-02-18T03:13:33.234 INFO:teuthology.orchestra.run.trial097.stdout:(44/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 30 MB/s | 442 kB 00:00 2026-02-18T03:13:33.240 INFO:teuthology.orchestra.run.trial097.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 12 MB/s | 77 kB 00:00 2026-02-18T03:13:33.253 INFO:teuthology.orchestra.run.trial097.stdout:(46/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 173 MB/s | 6.1 MB 00:00 2026-02-18T03:13:33.254 INFO:teuthology.orchestra.run.trial097.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 19 MB/s | 267 kB 00:00 2026-02-18T03:13:33.260 INFO:teuthology.orchestra.run.trial097.stdout:(48/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 22 MB/s | 159 kB 00:00 2026-02-18T03:13:33.261 INFO:teuthology.orchestra.run.trial097.stdout:(49/95): python3-pyasn1-modules-0.4.8-6.el9.noa 36 MB/s | 279 kB 00:00 2026-02-18T03:13:33.269 INFO:teuthology.orchestra.run.trial097.stdout:(50/95): python3-requests-oauthlib-1.3.0-12.el9 5.8 MB/s | 54 kB 00:00 2026-02-18T03:13:33.275 INFO:teuthology.orchestra.run.trial097.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 8.0 MB/s | 42 kB 00:00 2026-02-18T03:13:33.281 INFO:teuthology.orchestra.run.trial097.stdout:(52/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 28 MB/s | 189 kB 00:00 2026-02-18T03:13:33.287 INFO:teuthology.orchestra.run.trial097.stdout:(53/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 16 MB/s | 90 kB 00:00 2026-02-18T03:13:33.289 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:33.302 INFO:teuthology.orchestra.run.trial097.stdout:(54/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 35 MB/s | 5.3 MB 00:00 2026-02-18T03:13:33.306 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:33.315 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:33.318 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:33.376 INFO:teuthology.orchestra.run.trial194.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 9.9 MB/s | 5.1 MB 00:00 2026-02-18T03:13:33.438 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:16 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repository Size 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout:Install 5 Packages 2026-02-18T03:13:33.519 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:33.520 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 85 M 2026-02-18T03:13:33.520 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 364 M 2026-02-18T03:13:33.520 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:13:33.611 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:13:33.614 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:33.648 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:33.649 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:13:33.649 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:13:33.649 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:13:33.649 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:13:33.653 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:13:33.653 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:13:33.654 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:13:33.654 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:33.657 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:33.698 INFO:teuthology.orchestra.run.trial097.stdout:(55/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 44 MB/s | 19 MB 00:00 2026-02-18T03:13:33.699 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:13:33.699 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:33.699 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:33.700 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.700 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:33.700 INFO:teuthology.orchestra.run.trial078.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:13:33.700 INFO:teuthology.orchestra.run.trial078.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:13:33.700 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:13:33.700 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:33.700 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:33.737 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph 2026-02-18T03:13:33.786 INFO:teuthology.orchestra.run.trial194.stdout:(7/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 19 MB/s | 11 MB 00:00 2026-02-18T03:13:33.800 INFO:teuthology.orchestra.run.trial194.stdout:(8/95): ceph-mgr-diskprediction-local-20.2.0-67 17 MB/s | 7.4 MB 00:00 2026-02-18T03:13:33.801 INFO:teuthology.orchestra.run.trial194.stdout:(9/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 1.4 MB/s | 22 kB 00:00 2026-02-18T03:13:33.819 INFO:teuthology.orchestra.run.trial194.stdout:(10/95): ceph-mgr-modules-core-20.2.0-670.gadc1 15 MB/s | 290 kB 00:00 2026-02-18T03:13:33.821 INFO:teuthology.orchestra.run.trial194.stdout:(11/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 2.4 MB/s | 50 kB 00:00 2026-02-18T03:13:33.835 INFO:teuthology.orchestra.run.trial194.stdout:(12/95): ceph-prometheus-alerts-20.2.0-670.gadc 1.1 MB/s | 17 kB 00:00 2026-02-18T03:13:33.842 INFO:teuthology.orchestra.run.trial194.stdout:(13/95): ceph-volume-20.2.0-670.gadc19233.el9.n 14 MB/s | 297 kB 00:00 2026-02-18T03:13:33.857 INFO:teuthology.orchestra.run.trial097.stdout:(56/95): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2026-02-18T03:13:33.875 INFO:teuthology.orchestra.run.trial194.stdout:(14/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 21 MB/s | 17 MB 00:00 2026-02-18T03:13:33.886 INFO:teuthology.orchestra.run.trial031.stdout:(1/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 1.5 MB/s | 164 kB 00:00 2026-02-18T03:13:33.888 INFO:teuthology.orchestra.run.trial194.stdout:(15/95): cephadm-20.2.0-670.gadc19233.el9.noarc 19 MB/s | 1.0 MB 00:00 2026-02-18T03:13:34.027 INFO:teuthology.orchestra.run.trial097.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 114 kB/s | 19 kB 00:00 2026-02-18T03:13:34.046 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:24 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:34.048 INFO:teuthology.orchestra.run.trial097.stdout:(58/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.5 MB/s | 551 kB 00:00 2026-02-18T03:13:34.114 INFO:teuthology.orchestra.run.trial031.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 699 kB/s | 233 kB 00:00 2026-02-18T03:13:34.117 INFO:teuthology.orchestra.run.trial097.stdout:(59/95): python3-asyncssh-2.13.2-5.el9.noarch.r 7.7 MB/s | 548 kB 00:00 2026-02-18T03:13:34.131 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:13:34.134 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:13:34.135 INFO:teuthology.orchestra.run.trial078.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:13:34.136 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:13:34.137 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:13:34.138 INFO:teuthology.orchestra.run.trial078.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:13:34.139 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:13:34.140 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout:Installing weak dependencies: 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:13:34.141 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout:Install 95 Packages 2026-02-18T03:13:34.142 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:34.143 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 101 M 2026-02-18T03:13:34.143 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 561 M 2026-02-18T03:13:34.143 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:34.155 INFO:teuthology.orchestra.run.trial031.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 1.1 MB/s | 303 kB 00:00 2026-02-18T03:13:34.160 INFO:teuthology.orchestra.run.trial097.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 691 kB/s | 29 kB 00:00 2026-02-18T03:13:34.172 INFO:teuthology.orchestra.run.trial097.stdout:(61/95): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2026-02-18T03:13:34.204 INFO:teuthology.orchestra.run.trial097.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 1.3 MB/s | 60 kB 00:00 2026-02-18T03:13:34.205 INFO:teuthology.orchestra.run.trial031.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 700 kB/s | 64 kB 00:00 2026-02-18T03:13:34.220 INFO:teuthology.orchestra.run.trial097.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 916 kB/s | 43 kB 00:00 2026-02-18T03:13:34.247 INFO:teuthology.orchestra.run.trial097.stdout:(64/95): python3-cachetools-4.2.4-1.el9.noarch. 752 kB/s | 32 kB 00:00 2026-02-18T03:13:34.263 INFO:teuthology.orchestra.run.trial097.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 329 kB/s | 14 kB 00:00 2026-02-18T03:13:34.296 INFO:teuthology.orchestra.run.trial097.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 3.4 MB/s | 173 kB 00:00 2026-02-18T03:13:34.349 INFO:teuthology.orchestra.run.trial097.stdout:(67/95): python3-google-auth-2.45.0-1.el9.noarc 4.7 MB/s | 254 kB 00:00 2026-02-18T03:13:34.364 INFO:teuthology.orchestra.run.trial097.stdout:(68/95): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2026-02-18T03:13:34.413 INFO:teuthology.orchestra.run.trial097.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 2.9 MB/s | 144 kB 00:00 2026-02-18T03:13:34.461 INFO:teuthology.orchestra.run.trial097.stdout:(70/95): python3-influxdb-5.3.1-1.el9.noarch.rp 2.8 MB/s | 139 kB 00:00 2026-02-18T03:13:34.469 INFO:teuthology.orchestra.run.trial194.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 68 kB/s | 40 kB 00:00 2026-02-18T03:13:34.476 INFO:teuthology.orchestra.run.trial097.stdout:(71/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 16 MB/s | 2.0 MB 00:00 2026-02-18T03:13:34.506 INFO:teuthology.orchestra.run.trial097.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.2 MB/s | 56 kB 00:00 2026-02-18T03:13:34.518 INFO:teuthology.orchestra.run.trial097.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 259 kB/s | 11 kB 00:00 2026-02-18T03:13:34.549 INFO:teuthology.orchestra.run.trial097.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 412 kB/s | 18 kB 00:00 2026-02-18T03:13:34.559 INFO:teuthology.orchestra.run.trial097.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 556 kB/s | 23 kB 00:00 2026-02-18T03:13:34.592 INFO:teuthology.orchestra.run.trial097.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 457 kB/s | 20 kB 00:00 2026-02-18T03:13:34.601 INFO:teuthology.orchestra.run.trial097.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 468 kB/s | 19 kB 00:00 2026-02-18T03:13:34.604 INFO:teuthology.orchestra.run.trial194.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 101 kB/s | 72 kB 00:00 2026-02-18T03:13:34.635 INFO:teuthology.orchestra.run.trial097.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 616 kB/s | 26 kB 00:00 2026-02-18T03:13:34.657 INFO:teuthology.orchestra.run.trial097.stdout:(79/95): python3-kubernetes-26.1.0-3.el9.noarch 18 MB/s | 1.0 MB 00:00 2026-02-18T03:13:34.682 INFO:teuthology.orchestra.run.trial097.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 1.7 MB/s | 79 kB 00:00 2026-02-18T03:13:34.701 INFO:teuthology.orchestra.run.trial097.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.9 MB/s | 86 kB 00:00 2026-02-18T03:13:34.727 INFO:teuthology.orchestra.run.trial097.stdout:(82/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2026-02-18T03:13:34.743 INFO:teuthology.orchestra.run.trial097.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 396 kB/s | 16 kB 00:00 2026-02-18T03:13:34.773 INFO:teuthology.orchestra.run.trial097.stdout:(84/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.9 MB/s | 90 kB 00:00 2026-02-18T03:13:34.784 INFO:teuthology.orchestra.run.trial097.stdout:(85/95): python3-repoze-lru-0.7-16.el9.noarch.r 738 kB/s | 31 kB 00:00 2026-02-18T03:13:34.826 INFO:teuthology.orchestra.run.trial097.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 3.5 MB/s | 188 kB 00:00 2026-02-18T03:13:34.826 INFO:teuthology.orchestra.run.trial097.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2026-02-18T03:13:34.864 INFO:teuthology.orchestra.run.trial097.stdout:(88/95): protobuf-compiler-3.14.0-17.el9.x86_64 552 kB/s | 862 kB 00:01 2026-02-18T03:13:34.870 INFO:teuthology.orchestra.run.trial097.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 820 kB/s | 36 kB 00:00 2026-02-18T03:13:34.874 INFO:teuthology.orchestra.run.trial097.stdout:(90/95): python3-saml-1.16.0-1.el9.noarch.rpm 2.5 MB/s | 125 kB 00:00 2026-02-18T03:13:34.895 INFO:teuthology.orchestra.run.trial194.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 333 kB/s | 350 kB 00:01 2026-02-18T03:13:34.904 INFO:teuthology.orchestra.run.trial078.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 29 kB/s | 6.5 kB 00:00 2026-02-18T03:13:34.913 INFO:teuthology.orchestra.run.trial097.stdout:(91/95): python3-websocket-client-1.2.3-2.el9.n 2.0 MB/s | 90 kB 00:00 2026-02-18T03:13:34.918 INFO:teuthology.orchestra.run.trial097.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-18T03:13:34.956 INFO:teuthology.orchestra.run.trial097.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 523 kB/s | 22 kB 00:00 2026-02-18T03:13:34.960 INFO:teuthology.orchestra.run.trial097.stdout:(94/95): python3-zc-lockfile-2.0-10.el9.noarch. 473 kB/s | 20 kB 00:00 2026-02-18T03:13:34.998 INFO:teuthology.orchestra.run.trial194.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 468 kB/s | 184 kB 00:00 2026-02-18T03:13:35.103 INFO:teuthology.orchestra.run.trial097.stdout:(95/95): python3-typing-extensions-4.15.0-1.el9 362 kB/s | 86 kB 00:00 2026-02-18T03:13:35.107 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:35.107 INFO:teuthology.orchestra.run.trial097.stdout:Total 25 MB/s | 101 MB 00:04 2026-02-18T03:13:35.290 INFO:teuthology.orchestra.run.trial194.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 641 kB/s | 253 kB 00:00 2026-02-18T03:13:35.529 INFO:teuthology.orchestra.run.trial194.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 445 kB/s | 106 kB 00:00 2026-02-18T03:13:35.549 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:35.562 INFO:teuthology.orchestra.run.trial194.stdout:(22/95): libgfortran-11.5.0-14.el9.x86_64.rpm 727 kB/s | 794 kB 00:01 2026-02-18T03:13:35.588 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:35.588 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:35.731 INFO:teuthology.orchestra.run.trial078.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 918 kB/s | 961 kB 00:01 2026-02-18T03:13:35.767 INFO:teuthology.orchestra.run.trial194.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 568 kB/s | 135 kB 00:00 2026-02-18T03:13:35.876 INFO:teuthology.orchestra.run.trial194.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 480 kB/s | 150 kB 00:00 2026-02-18T03:13:35.894 INFO:teuthology.orchestra.run.trial078.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 1.9 MB/s | 2.3 MB 00:01 2026-02-18T03:13:35.907 INFO:teuthology.orchestra.run.trial078.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 3.3 MB/s | 43 kB 00:00 2026-02-18T03:13:35.945 INFO:teuthology.orchestra.run.trial078.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 4.5 MB/s | 173 kB 00:00 2026-02-18T03:13:36.006 INFO:teuthology.orchestra.run.trial194.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 530 kB/s | 126 kB 00:00 2026-02-18T03:13:36.019 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:36.019 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:36.269 INFO:teuthology.orchestra.run.trial194.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 553 kB/s | 218 kB 00:00 2026-02-18T03:13:36.322 INFO:teuthology.orchestra.run.trial194.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 575 kB/s | 182 kB 00:00 2026-02-18T03:13:36.401 INFO:teuthology.orchestra.run.trial194.stdout:(28/95): flexiblas-3.0.4-9.el9.x86_64.rpm 376 kB/s | 30 kB 00:00 2026-02-18T03:13:36.474 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:36.477 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:13:36.480 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:13:36.502 INFO:teuthology.orchestra.run.trial097.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:13:36.536 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:13:36.545 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:13:36.551 INFO:teuthology.orchestra.run.trial097.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:13:36.553 INFO:teuthology.orchestra.run.trial097.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:13:36.558 INFO:teuthology.orchestra.run.trial097.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:13:36.573 INFO:teuthology.orchestra.run.trial194.stdout:(29/95): python3-cryptography-36.0.1-5.el9.x86_ 810 kB/s | 1.2 MB 00:01 2026-02-18T03:13:36.581 INFO:teuthology.orchestra.run.trial097.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:13:36.594 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:13:36.597 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:13:36.603 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:13:36.605 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:13:36.611 INFO:teuthology.orchestra.run.trial194.stdout:(30/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 14 MB/s | 3.0 MB 00:00 2026-02-18T03:13:36.613 INFO:teuthology.orchestra.run.trial078.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 3.0 MB/s | 5.1 MB 00:01 2026-02-18T03:13:36.616 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:13:36.622 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:13:36.631 INFO:teuthology.orchestra.run.trial194.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 259 kB/s | 15 kB 00:00 2026-02-18T03:13:36.646 INFO:teuthology.orchestra.run.trial097.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:13:36.649 INFO:teuthology.orchestra.run.trial097.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:13:36.656 INFO:teuthology.orchestra.run.trial097.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:13:36.664 INFO:teuthology.orchestra.run.trial194.stdout:(32/95): zip-3.0-35.el9.x86_64.rpm 673 kB/s | 266 kB 00:00 2026-02-18T03:13:36.678 INFO:teuthology.orchestra.run.trial194.stdout:(33/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.6 MB/s | 246 kB 00:00 2026-02-18T03:13:36.707 INFO:teuthology.orchestra.run.trial097.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:13:36.720 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:13:36.723 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:13:36.728 INFO:teuthology.orchestra.run.trial097.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:13:36.730 INFO:teuthology.orchestra.run.trial194.stdout:(34/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 102 MB/s | 5.3 MB 00:00 2026-02-18T03:13:36.731 INFO:teuthology.orchestra.run.trial194.stdout:(35/95): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2026-02-18T03:13:36.733 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:13:36.738 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:13:36.741 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:13:36.756 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:13:36.760 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:13:36.760 INFO:teuthology.orchestra.run.trial194.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 33 MB/s | 1.0 MB 00:00 2026-02-18T03:13:36.765 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:13:36.776 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:13:36.785 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:13:36.789 INFO:teuthology.orchestra.run.trial194.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 8.3 MB/s | 244 kB 00:00 2026-02-18T03:13:36.792 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:13:36.806 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:36.811 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:13:36.822 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:13:36.825 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:36.838 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:13:36.843 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:13:36.851 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:13:36.853 INFO:teuthology.orchestra.run.trial194.stdout:(38/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 3.8 MB/s | 249 kB 00:00 2026-02-18T03:13:36.890 INFO:teuthology.orchestra.run.trial194.stdout:(39/95): python3-jmespath-1.0.1-1.el9.noarch.rp 1.3 MB/s | 48 kB 00:00 2026-02-18T03:13:36.890 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:13:36.912 INFO:teuthology.orchestra.run.trial194.stdout:(40/95): python3-libstoragemgmt-1.10.1-1.el9.x8 7.9 MB/s | 177 kB 00:00 2026-02-18T03:13:36.940 INFO:teuthology.orchestra.run.trial194.stdout:(41/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 44 MB/s | 1.2 MB 00:00 2026-02-18T03:13:36.961 INFO:teuthology.orchestra.run.trial194.stdout:(42/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.6 MB/s | 35 kB 00:00 2026-02-18T03:13:37.076 INFO:teuthology.orchestra.run.trial194.stdout:(43/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 53 MB/s | 6.1 MB 00:00 2026-02-18T03:13:37.100 INFO:teuthology.orchestra.run.trial194.stdout:(44/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 18 MB/s | 442 kB 00:00 2026-02-18T03:13:37.121 INFO:teuthology.orchestra.run.trial194.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 3.6 MB/s | 77 kB 00:00 2026-02-18T03:13:37.127 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:37.127 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:13:37.128 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:13:37.128 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:13:37.128 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:13:37.146 INFO:teuthology.orchestra.run.trial194.stdout:(46/95): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-18T03:13:37.163 INFO:teuthology.orchestra.run.trial194.stdout:(47/95): openblas-0.3.29-1.el9.x86_64.rpm 84 kB/s | 42 kB 00:00 2026-02-18T03:13:37.169 INFO:teuthology.orchestra.run.trial194.stdout:(48/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.8 MB/s | 159 kB 00:00 2026-02-18T03:13:37.179 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:13:37.179 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:37.179 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:13:37.179 INFO:teuthology.orchestra.run.trial114.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:37.179 INFO:teuthology.orchestra.run.trial114.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:37.179 INFO:teuthology.orchestra.run.trial114.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:13:37.179 INFO:teuthology.orchestra.run.trial114.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:13:37.179 INFO:teuthology.orchestra.run.trial114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:13:37.180 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:37.180 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:37.202 INFO:teuthology.orchestra.run.trial194.stdout:(49/95): python3-requests-oauthlib-1.3.0-12.el9 1.6 MB/s | 54 kB 00:00 2026-02-18T03:13:37.216 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:13:37.218 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph 2026-02-18T03:13:37.226 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:13:37.230 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:13:37.236 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:13:37.238 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:13:37.266 INFO:teuthology.orchestra.run.trial097.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:13:37.303 INFO:teuthology.orchestra.run.trial031.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 24 MB/s | 84 MB 00:03 2026-02-18T03:13:37.304 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:37.304 INFO:teuthology.orchestra.run.trial031.stdout:Total 22 MB/s | 85 MB 00:03 2026-02-18T03:13:37.310 INFO:teuthology.orchestra.run.trial097.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:13:37.316 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:13:37.320 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:13:37.325 INFO:teuthology.orchestra.run.trial078.stdout:(7/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 7.7 MB/s | 11 MB 00:01 2026-02-18T03:13:37.326 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:13:37.329 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:13:37.330 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:13:37.336 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:13:37.338 INFO:teuthology.orchestra.run.trial078.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 1.7 MB/s | 22 kB 00:00 2026-02-18T03:13:37.340 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:13:37.341 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:13:37.341 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:13:37.361 INFO:teuthology.orchestra.run.trial078.stdout:(9/95): ceph-mgr-modules-core-20.2.0-670.gadc19 12 MB/s | 290 kB 00:00 2026-02-18T03:13:37.368 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:13:37.373 INFO:teuthology.orchestra.run.trial078.stdout:(10/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 4.2 MB/s | 50 kB 00:00 2026-02-18T03:13:37.378 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:13:37.384 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:13:37.385 INFO:teuthology.orchestra.run.trial078.stdout:(11/95): ceph-prometheus-alerts-20.2.0-670.gadc 1.5 MB/s | 17 kB 00:00 2026-02-18T03:13:37.391 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:13:37.408 INFO:teuthology.orchestra.run.trial078.stdout:(12/95): ceph-volume-20.2.0-670.gadc19233.el9.n 13 MB/s | 297 kB 00:00 2026-02-18T03:13:37.414 INFO:teuthology.orchestra.run.trial194.stdout:(50/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 91 MB/s | 19 MB 00:00 2026-02-18T03:13:37.425 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:13:37.436 INFO:teuthology.orchestra.run.trial194.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.9 MB/s | 42 kB 00:00 2026-02-18T03:13:37.460 INFO:teuthology.orchestra.run.trial194.stdout:(52/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.8 MB/s | 189 kB 00:00 2026-02-18T03:13:37.482 INFO:teuthology.orchestra.run.trial194.stdout:(53/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.9 MB/s | 90 kB 00:00 2026-02-18T03:13:37.486 INFO:teuthology.orchestra.run.trial078.stdout:(13/95): cephadm-20.2.0-670.gadc19233.el9.noarc 13 MB/s | 1.0 MB 00:00 2026-02-18T03:13:37.509 INFO:teuthology.orchestra.run.trial194.stdout:(54/95): lua-devel-5.4.4-4.el9.x86_64.rpm 832 kB/s | 22 kB 00:00 2026-02-18T03:13:37.533 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:21 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:37.541 INFO:teuthology.orchestra.run.trial078.stdout:(14/95): ceph-mgr-diskprediction-local-20.2.0-6 8.0 MB/s | 7.4 MB 00:00 2026-02-18T03:13:37.548 INFO:teuthology.orchestra.run.trial078.stdout:(15/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 5.5 MB/s | 350 kB 00:00 2026-02-18T03:13:37.562 INFO:teuthology.orchestra.run.trial194.stdout:(55/95): protobuf-compiler-3.14.0-17.el9.x86_64 16 MB/s | 862 kB 00:00 2026-02-18T03:13:37.572 INFO:teuthology.orchestra.run.trial078.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.3 MB/s | 40 kB 00:00 2026-02-18T03:13:37.575 INFO:teuthology.orchestra.run.trial078.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 2.6 MB/s | 72 kB 00:00 2026-02-18T03:13:37.619 INFO:teuthology.orchestra.run.trial078.stdout:(18/95): libquadmath-11.5.0-14.el9.x86_64.rpm 4.2 MB/s | 184 kB 00:00 2026-02-18T03:13:37.619 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:37.621 INFO:teuthology.orchestra.run.trial078.stdout:(19/95): libgfortran-11.5.0-14.el9.x86_64.rpm 16 MB/s | 794 kB 00:00 2026-02-18T03:13:37.622 INFO:teuthology.orchestra.run.trial114.stdout:====================================================================================== 2026-02-18T03:13:37.622 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-18T03:13:37.622 INFO:teuthology.orchestra.run.trial114.stdout:====================================================================================== 2026-02-18T03:13:37.622 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:13:37.622 INFO:teuthology.orchestra.run.trial114.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:13:37.622 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-18T03:13:37.622 INFO:teuthology.orchestra.run.trial114.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:13:37.622 INFO:teuthology.orchestra.run.trial114.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:13:37.623 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:13:37.624 INFO:teuthology.orchestra.run.trial114.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:13:37.625 INFO:teuthology.orchestra.run.trial114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:13:37.626 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:13:37.627 INFO:teuthology.orchestra.run.trial114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:13:37.628 INFO:teuthology.orchestra.run.trial114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:13:37.629 INFO:teuthology.orchestra.run.trial114.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout:Installing weak dependencies: 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:13:37.630 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:37.631 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:13:37.631 INFO:teuthology.orchestra.run.trial114.stdout:====================================================================================== 2026-02-18T03:13:37.631 INFO:teuthology.orchestra.run.trial114.stdout:Install 95 Packages 2026-02-18T03:13:37.631 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:37.632 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:13:37.632 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:13:37.632 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 101 M 2026-02-18T03:13:37.633 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 561 M 2026-02-18T03:13:37.633 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:13:37.650 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:13:37.658 INFO:teuthology.orchestra.run.trial078.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.2 MB/s | 253 kB 00:00 2026-02-18T03:13:37.665 INFO:teuthology.orchestra.run.trial078.stdout:(21/95): python3-cryptography-36.0.1-5.el9.x86_ 28 MB/s | 1.2 MB 00:00 2026-02-18T03:13:37.674 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:13:37.678 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:13:37.682 INFO:teuthology.orchestra.run.trial078.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 4.5 MB/s | 106 kB 00:00 2026-02-18T03:13:37.698 INFO:teuthology.orchestra.run.trial078.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 4.1 MB/s | 135 kB 00:00 2026-02-18T03:13:37.712 INFO:teuthology.orchestra.run.trial078.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 4.9 MB/s | 150 kB 00:00 2026-02-18T03:13:37.728 INFO:teuthology.orchestra.run.trial078.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 4.1 MB/s | 126 kB 00:00 2026-02-18T03:13:37.736 INFO:teuthology.orchestra.run.trial097.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:13:37.738 INFO:teuthology.orchestra.run.trial097.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:13:37.746 INFO:teuthology.orchestra.run.trial194.stdout:(56/95): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2026-02-18T03:13:37.747 INFO:teuthology.orchestra.run.trial078.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 6.0 MB/s | 218 kB 00:00 2026-02-18T03:13:37.756 INFO:teuthology.orchestra.run.trial078.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 6.4 MB/s | 182 kB 00:00 2026-02-18T03:13:37.759 INFO:teuthology.orchestra.run.trial097.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:13:37.776 INFO:teuthology.orchestra.run.trial078.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 9.0 MB/s | 266 kB 00:00 2026-02-18T03:13:37.822 INFO:teuthology.orchestra.run.trial078.stdout:(29/95): flexiblas-3.0.4-9.el9.x86_64.rpm 444 kB/s | 30 kB 00:00 2026-02-18T03:13:37.845 INFO:teuthology.orchestra.run.trial078.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-9.el9. 655 kB/s | 15 kB 00:00 2026-02-18T03:13:37.848 INFO:teuthology.orchestra.run.trial194.stdout:(57/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.9 MB/s | 551 kB 00:00 2026-02-18T03:13:37.858 INFO:teuthology.orchestra.run.trial194.stdout:(58/95): grpc-data-1.46.7-10.el9.noarch.rpm 175 kB/s | 19 kB 00:00 2026-02-18T03:13:37.877 INFO:teuthology.orchestra.run.trial078.stdout:(31/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 7.9 MB/s | 17 MB 00:02 2026-02-18T03:13:37.890 INFO:teuthology.orchestra.run.trial194.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2026-02-18T03:13:37.922 INFO:teuthology.orchestra.run.trial078.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.1 MB/s | 246 kB 00:00 2026-02-18T03:13:37.928 INFO:teuthology.orchestra.run.trial194.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 791 kB/s | 29 kB 00:00 2026-02-18T03:13:37.943 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:13:37.945 INFO:teuthology.orchestra.run.trial078.stdout:(33/95): openblas-0.3.29-1.el9.x86_64.rpm 1.8 MB/s | 42 kB 00:00 2026-02-18T03:13:37.949 INFO:teuthology.orchestra.run.trial031.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:13:37.954 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:13:37.959 INFO:teuthology.orchestra.run.trial194.stdout:(61/95): python3-pyasn1-modules-0.4.8-6.el9.noa 350 kB/s | 279 kB 00:00 2026-02-18T03:13:37.960 INFO:teuthology.orchestra.run.trial078.stdout:(34/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 16 MB/s | 3.0 MB 00:00 2026-02-18T03:13:37.962 INFO:teuthology.orchestra.run.trial031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:13:37.963 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:37.966 INFO:teuthology.orchestra.run.trial194.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 1.5 MB/s | 60 kB 00:00 2026-02-18T03:13:37.984 INFO:teuthology.orchestra.run.trial078.stdout:(35/95): protobuf-3.14.0-17.el9.x86_64.rpm 42 MB/s | 1.0 MB 00:00 2026-02-18T03:13:37.988 INFO:teuthology.orchestra.run.trial078.stdout:(36/95): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2026-02-18T03:13:38.003 INFO:teuthology.orchestra.run.trial194.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 866 kB/s | 32 kB 00:00 2026-02-18T03:13:38.038 INFO:teuthology.orchestra.run.trial078.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2026-02-18T03:13:38.040 INFO:teuthology.orchestra.run.trial194.stdout:(64/95): python3-certifi-2023.05.07-4.el9.noarc 384 kB/s | 14 kB 00:00 2026-02-18T03:13:38.059 INFO:teuthology.orchestra.run.trial194.stdout:(65/95): python3-asyncssh-2.13.2-5.el9.noarch.r 2.7 MB/s | 548 kB 00:00 2026-02-18T03:13:38.069 INFO:teuthology.orchestra.run.trial078.stdout:(38/95): python3-babel-2.9.1-2.el9.noarch.rpm 70 MB/s | 6.0 MB 00:00 2026-02-18T03:13:38.070 INFO:teuthology.orchestra.run.trial078.stdout:(39/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 7.6 MB/s | 249 kB 00:00 2026-02-18T03:13:38.085 INFO:teuthology.orchestra.run.trial194.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 3.8 MB/s | 173 kB 00:00 2026-02-18T03:13:38.086 INFO:teuthology.orchestra.run.trial097.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:13:38.089 INFO:teuthology.orchestra.run.trial078.stdout:(40/95): python3-jmespath-1.0.1-1.el9.noarch.rp 2.3 MB/s | 48 kB 00:00 2026-02-18T03:13:38.096 INFO:teuthology.orchestra.run.trial078.stdout:(41/95): python3-libstoragemgmt-1.10.1-1.el9.x8 6.6 MB/s | 177 kB 00:00 2026-02-18T03:13:38.102 INFO:teuthology.orchestra.run.trial194.stdout:(67/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 303 kB/s | 43 kB 00:00 2026-02-18T03:13:38.112 INFO:teuthology.orchestra.run.trial194.stdout:(68/95): python3-cherrypy-18.6.1-2.el9.noarch.r 6.7 MB/s | 358 kB 00:00 2026-02-18T03:13:38.113 INFO:teuthology.orchestra.run.trial078.stdout:(42/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 51 MB/s | 1.2 MB 00:00 2026-02-18T03:13:38.120 INFO:teuthology.orchestra.run.trial078.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.4 MB/s | 35 kB 00:00 2026-02-18T03:13:38.132 INFO:teuthology.orchestra.run.trial194.stdout:(69/95): python3-google-auth-2.45.0-1.el9.noarc 5.3 MB/s | 254 kB 00:00 2026-02-18T03:13:38.155 INFO:teuthology.orchestra.run.trial194.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 3.3 MB/s | 144 kB 00:00 2026-02-18T03:13:38.159 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:13:38.160 INFO:teuthology.orchestra.run.trial078.stdout:(44/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 25 MB/s | 5.3 MB 00:00 2026-02-18T03:13:38.174 INFO:teuthology.orchestra.run.trial194.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 3.2 MB/s | 139 kB 00:00 2026-02-18T03:13:38.188 INFO:teuthology.orchestra.run.trial078.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 2.6 MB/s | 77 kB 00:00 2026-02-18T03:13:38.191 INFO:teuthology.orchestra.run.trial078.stdout:(46/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 6.1 MB/s | 442 kB 00:00 2026-02-18T03:13:38.194 INFO:teuthology.orchestra.run.trial194.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.4 MB/s | 56 kB 00:00 2026-02-18T03:13:38.195 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:38.195 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /sys 2026-02-18T03:13:38.195 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /proc 2026-02-18T03:13:38.195 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /mnt 2026-02-18T03:13:38.195 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /var/tmp 2026-02-18T03:13:38.196 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /home 2026-02-18T03:13:38.196 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /root 2026-02-18T03:13:38.196 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /tmp 2026-02-18T03:13:38.196 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:38.211 INFO:teuthology.orchestra.run.trial194.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 290 kB/s | 11 kB 00:00 2026-02-18T03:13:38.214 INFO:teuthology.orchestra.run.trial078.stdout:(47/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 61 MB/s | 6.1 MB 00:00 2026-02-18T03:13:38.215 INFO:teuthology.orchestra.run.trial078.stdout:(48/95): python3-protobuf-3.14.0-17.el9.noarch. 9.9 MB/s | 267 kB 00:00 2026-02-18T03:13:38.216 INFO:teuthology.orchestra.run.trial078.stdout:(49/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.1 MB/s | 159 kB 00:00 2026-02-18T03:13:38.231 INFO:teuthology.orchestra.run.trial194.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 470 kB/s | 18 kB 00:00 2026-02-18T03:13:38.236 INFO:teuthology.orchestra.run.trial078.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 12 MB/s | 279 kB 00:00 2026-02-18T03:13:38.239 INFO:teuthology.orchestra.run.trial078.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 2.2 MB/s | 54 kB 00:00 2026-02-18T03:13:38.248 INFO:teuthology.orchestra.run.trial194.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 625 kB/s | 23 kB 00:00 2026-02-18T03:13:38.257 INFO:teuthology.orchestra.run.trial078.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 2.0 MB/s | 42 kB 00:00 2026-02-18T03:13:38.265 INFO:teuthology.orchestra.run.trial078.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.2 MB/s | 189 kB 00:00 2026-02-18T03:13:38.270 INFO:teuthology.orchestra.run.trial194.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 504 kB/s | 20 kB 00:00 2026-02-18T03:13:38.277 INFO:teuthology.orchestra.run.trial078.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 4.4 MB/s | 90 kB 00:00 2026-02-18T03:13:38.280 INFO:teuthology.orchestra.run.trial114.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 103 kB/s | 6.5 kB 00:00 2026-02-18T03:13:38.285 INFO:teuthology.orchestra.run.trial194.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 522 kB/s | 19 kB 00:00 2026-02-18T03:13:38.308 INFO:teuthology.orchestra.run.trial194.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 696 kB/s | 26 kB 00:00 2026-02-18T03:13:38.338 INFO:teuthology.orchestra.run.trial194.stdout:(79/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.6 MB/s | 2.0 MB 00:00 2026-02-18T03:13:38.370 INFO:teuthology.orchestra.run.trial194.stdout:(80/95): python3-kubernetes-26.1.0-3.el9.noarch 12 MB/s | 1.0 MB 00:00 2026-02-18T03:13:38.377 INFO:teuthology.orchestra.run.trial194.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2026-02-18T03:13:38.385 INFO:teuthology.orchestra.run.trial194.stdout:(82/95): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2026-02-18T03:13:38.408 INFO:teuthology.orchestra.run.trial194.stdout:(83/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.5 MB/s | 58 kB 00:00 2026-02-18T03:13:38.413 INFO:teuthology.orchestra.run.trial194.stdout:(84/95): python3-portend-3.1.0-2.el9.noarch.rpm 446 kB/s | 16 kB 00:00 2026-02-18T03:13:38.426 INFO:teuthology.orchestra.run.trial194.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2026-02-18T03:13:38.432 INFO:teuthology.orchestra.run.trial078.stdout:(55/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 89 MB/s | 19 MB 00:00 2026-02-18T03:13:38.441 INFO:teuthology.orchestra.run.trial114.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 4.2 MB/s | 961 kB 00:00 2026-02-18T03:13:38.445 INFO:teuthology.orchestra.run.trial194.stdout:(86/95): python3-repoze-lru-0.7-16.el9.noarch.r 828 kB/s | 31 kB 00:00 2026-02-18T03:13:38.452 INFO:teuthology.orchestra.run.trial194.stdout:(87/95): python3-routes-2.5.1-5.el9.noarch.rpm 4.9 MB/s | 188 kB 00:00 2026-02-18T03:13:38.465 INFO:teuthology.orchestra.run.trial194.stdout:(88/95): python3-rsa-4.9-2.el9.noarch.rpm 1.5 MB/s | 59 kB 00:00 2026-02-18T03:13:38.484 INFO:teuthology.orchestra.run.trial194.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 3.1 MB/s | 125 kB 00:00 2026-02-18T03:13:38.489 INFO:teuthology.orchestra.run.trial194.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 961 kB/s | 36 kB 00:00 2026-02-18T03:13:38.506 INFO:teuthology.orchestra.run.trial194.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 2.1 MB/s | 86 kB 00:00 2026-02-18T03:13:38.521 INFO:teuthology.orchestra.run.trial114.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 7.7 MB/s | 2.3 MB 00:00 2026-02-18T03:13:38.526 INFO:teuthology.orchestra.run.trial194.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2026-02-18T03:13:38.526 INFO:teuthology.orchestra.run.trial194.stdout:(93/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.3 MB/s | 48 kB 00:00 2026-02-18T03:13:38.532 INFO:teuthology.orchestra.run.trial114.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 3.7 MB/s | 43 kB 00:00 2026-02-18T03:13:38.544 INFO:teuthology.orchestra.run.trial194.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 584 kB/s | 22 kB 00:00 2026-02-18T03:13:38.544 INFO:teuthology.orchestra.run.trial114.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 14 MB/s | 173 kB 00:00 2026-02-18T03:13:38.564 INFO:teuthology.orchestra.run.trial194.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 529 kB/s | 20 kB 00:00 2026-02-18T03:13:38.566 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:38.566 INFO:teuthology.orchestra.run.trial194.stdout:Total 16 MB/s | 101 MB 00:06 2026-02-18T03:13:38.578 INFO:teuthology.orchestra.run.trial078.stdout:(56/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.7 MB/s | 551 kB 00:00 2026-02-18T03:13:38.600 INFO:teuthology.orchestra.run.trial078.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 870 kB/s | 19 kB 00:00 2026-02-18T03:13:38.624 INFO:teuthology.orchestra.run.trial078.stdout:(58/95): luarocks-3.9.2-5.el9.noarch.rpm 6.3 MB/s | 151 kB 00:00 2026-02-18T03:13:38.650 INFO:teuthology.orchestra.run.trial078.stdout:(59/95): python3-asyncssh-2.13.2-5.el9.noarch.r 20 MB/s | 548 kB 00:00 2026-02-18T03:13:38.669 INFO:teuthology.orchestra.run.trial078.stdout:(60/95): lua-devel-5.4.4-4.el9.x86_64.rpm 55 kB/s | 22 kB 00:00 2026-02-18T03:13:38.672 INFO:teuthology.orchestra.run.trial078.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 1.3 MB/s | 29 kB 00:00 2026-02-18T03:13:38.696 INFO:teuthology.orchestra.run.trial078.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.8 MB/s | 43 kB 00:00 2026-02-18T03:13:38.719 INFO:teuthology.orchestra.run.trial078.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 1.4 MB/s | 32 kB 00:00 2026-02-18T03:13:38.742 INFO:teuthology.orchestra.run.trial078.stdout:(64/95): python3-certifi-2023.05.07-4.el9.noarc 631 kB/s | 14 kB 00:00 2026-02-18T03:13:38.768 INFO:teuthology.orchestra.run.trial078.stdout:(65/95): python3-cheroot-10.0.1-4.el9.noarch.rp 6.5 MB/s | 173 kB 00:00 2026-02-18T03:13:38.775 INFO:teuthology.orchestra.run.trial078.stdout:(66/95): python3-backports-tarfile-1.2.0-1.el9. 570 kB/s | 60 kB 00:00 2026-02-18T03:13:38.801 INFO:teuthology.orchestra.run.trial078.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2026-02-18T03:13:38.834 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:13:38.840 INFO:teuthology.orchestra.run.trial114.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 9.0 MB/s | 5.1 MB 00:00 2026-02-18T03:13:38.850 INFO:teuthology.orchestra.run.trial078.stdout:(68/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 41 MB/s | 2.0 MB 00:00 2026-02-18T03:13:38.851 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:13:38.857 INFO:teuthology.orchestra.run.trial078.stdout:(69/95): python3-google-auth-2.45.0-1.el9.noarc 3.0 MB/s | 254 kB 00:00 2026-02-18T03:13:38.861 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:13:38.870 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:13:38.876 INFO:teuthology.orchestra.run.trial078.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 5.5 MB/s | 144 kB 00:00 2026-02-18T03:13:38.882 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:13:38.889 INFO:teuthology.orchestra.run.trial078.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 4.2 MB/s | 139 kB 00:00 2026-02-18T03:13:38.897 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:13:38.900 INFO:teuthology.orchestra.run.trial078.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 2.3 MB/s | 56 kB 00:00 2026-02-18T03:13:38.918 INFO:teuthology.orchestra.run.trial078.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 369 kB/s | 11 kB 00:00 2026-02-18T03:13:38.922 INFO:teuthology.orchestra.run.trial078.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 794 kB/s | 18 kB 00:00 2026-02-18T03:13:38.944 INFO:teuthology.orchestra.run.trial078.stdout:(75/95): python3-jaraco-context-6.0.1-3.el9.noa 907 kB/s | 20 kB 00:00 2026-02-18T03:13:38.947 INFO:teuthology.orchestra.run.trial078.stdout:(76/95): python3-jaraco-collections-3.0.0-8.el9 796 kB/s | 23 kB 00:00 2026-02-18T03:13:38.966 INFO:teuthology.orchestra.run.trial078.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 858 kB/s | 19 kB 00:00 2026-02-18T03:13:38.972 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:13:38.977 INFO:teuthology.orchestra.run.trial078.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 892 kB/s | 26 kB 00:00 2026-02-18T03:13:38.981 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:13:38.993 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:39.000 INFO:teuthology.orchestra.run.trial078.stdout:(79/95): python3-kubernetes-26.1.0-3.el9.noarch 31 MB/s | 1.0 MB 00:00 2026-02-18T03:13:39.005 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:13:39.007 INFO:teuthology.orchestra.run.trial078.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 2.6 MB/s | 79 kB 00:00 2026-02-18T03:13:39.025 INFO:teuthology.orchestra.run.trial078.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.4 MB/s | 86 kB 00:00 2026-02-18T03:13:39.031 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:39.031 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:39.034 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:13:39.038 INFO:teuthology.orchestra.run.trial078.stdout:(82/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.8 MB/s | 58 kB 00:00 2026-02-18T03:13:39.046 INFO:teuthology.orchestra.run.trial078.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 755 kB/s | 16 kB 00:00 2026-02-18T03:13:39.054 INFO:teuthology.orchestra.run.trial114.stdout:(7/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 21 MB/s | 11 MB 00:00 2026-02-18T03:13:39.069 INFO:teuthology.orchestra.run.trial078.stdout:(84/95): python3-repoze-lru-0.7-16.el9.noarch.r 1.4 MB/s | 31 kB 00:00 2026-02-18T03:13:39.069 INFO:teuthology.orchestra.run.trial078.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.8 MB/s | 90 kB 00:00 2026-02-18T03:13:39.083 INFO:teuthology.orchestra.run.trial114.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 775 kB/s | 22 kB 00:00 2026-02-18T03:13:39.085 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:13:39.091 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:13:39.094 INFO:teuthology.orchestra.run.trial078.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2026-02-18T03:13:39.095 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:13:39.096 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:13:39.099 INFO:teuthology.orchestra.run.trial078.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2026-02-18T03:13:39.113 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:39.113 INFO:teuthology.orchestra.run.trial097.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:13:39.113 INFO:teuthology.orchestra.run.trial097.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:13:39.113 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:39.118 INFO:teuthology.orchestra.run.trial114.stdout:(9/95): ceph-mgr-modules-core-20.2.0-670.gadc19 8.1 MB/s | 290 kB 00:00 2026-02-18T03:13:39.118 INFO:teuthology.orchestra.run.trial078.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 5.0 MB/s | 125 kB 00:00 2026-02-18T03:13:39.121 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:39.129 INFO:teuthology.orchestra.run.trial078.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 1.2 MB/s | 36 kB 00:00 2026-02-18T03:13:39.142 INFO:teuthology.orchestra.run.trial078.stdout:(90/95): python3-typing-extensions-4.15.0-1.el9 3.6 MB/s | 86 kB 00:00 2026-02-18T03:13:39.145 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:39.146 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:13:39.146 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:39.150 INFO:teuthology.orchestra.run.trial114.stdout:(10/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 1.5 MB/s | 50 kB 00:00 2026-02-18T03:13:39.159 INFO:teuthology.orchestra.run.trial078.stdout:(91/95): python3-websocket-client-1.2.3-2.el9.n 2.9 MB/s | 90 kB 00:00 2026-02-18T03:13:39.166 INFO:teuthology.orchestra.run.trial078.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.0 MB/s | 48 kB 00:00 2026-02-18T03:13:39.180 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:13:39.183 INFO:teuthology.orchestra.run.trial114.stdout:(11/95): ceph-prometheus-alerts-20.2.0-670.gadc 526 kB/s | 17 kB 00:00 2026-02-18T03:13:39.189 INFO:teuthology.orchestra.run.trial078.stdout:(93/95): python3-zc-lockfile-2.0-10.el9.noarch. 856 kB/s | 20 kB 00:00 2026-02-18T03:13:39.191 INFO:teuthology.orchestra.run.trial078.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 694 kB/s | 22 kB 00:00 2026-02-18T03:13:39.219 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:39.223 INFO:teuthology.orchestra.run.trial114.stdout:(12/95): ceph-volume-20.2.0-670.gadc19233.el9.n 7.3 MB/s | 297 kB 00:00 2026-02-18T03:13:39.242 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:13:39.242 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:39.242 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:13:39.242 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:39.243 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:13:39.243 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:39.243 INFO:teuthology.orchestra.run.trial097.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:13:39.244 INFO:teuthology.orchestra.run.trial119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:39.245 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:39.257 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:13:39.257 INFO:teuthology.orchestra.run.trial119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:39.258 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:39.259 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:39.259 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:13:39.259 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:39.311 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:39.311 INFO:teuthology.orchestra.run.trial119.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:13:39.311 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:39.324 INFO:teuthology.orchestra.run.trial114.stdout:(13/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 19 MB/s | 17 MB 00:00 2026-02-18T03:13:39.327 INFO:teuthology.orchestra.run.trial114.stdout:(14/95): cephadm-20.2.0-670.gadc19233.el9.noarc 9.6 MB/s | 1.0 MB 00:00 2026-02-18T03:13:39.403 INFO:teuthology.orchestra.run.trial114.stdout:(15/95): ceph-mgr-diskprediction-local-20.2.0-6 13 MB/s | 7.4 MB 00:00 2026-02-18T03:13:39.461 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:39.462 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:39.609 INFO:teuthology.orchestra.run.trial114.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 143 kB/s | 40 kB 00:00 2026-02-18T03:13:39.631 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:13:39.632 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:13:39.633 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:13:39.634 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:13:39.635 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:13:39.635 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:13:39.686 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:13:39.686 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:39.686 INFO:teuthology.orchestra.run.trial119.stdout:Upgraded: 2026-02-18T03:13:39.686 INFO:teuthology.orchestra.run.trial119.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:13:39.687 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:13:39.688 INFO:teuthology.orchestra.run.trial119.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:13:39.689 INFO:teuthology.orchestra.run.trial119.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:13:39.690 INFO:teuthology.orchestra.run.trial119.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:13:39.690 INFO:teuthology.orchestra.run.trial119.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:13:39.690 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:39.690 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:13:39.690 INFO:teuthology.orchestra.run.trial078.stdout:(95/95): protobuf-compiler-3.14.0-17.el9.x86_64 612 kB/s | 862 kB 00:01 2026-02-18T03:13:39.692 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:39.692 INFO:teuthology.orchestra.run.trial078.stdout:Total 18 MB/s | 101 MB 00:05 2026-02-18T03:13:39.728 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-test 2026-02-18T03:13:39.761 INFO:teuthology.orchestra.run.trial114.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 202 kB/s | 72 kB 00:00 2026-02-18T03:13:39.863 INFO:teuthology.orchestra.run.trial114.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 650 kB/s | 350 kB 00:00 2026-02-18T03:13:39.916 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:39.918 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:13:39.923 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:13:39.931 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:39.943 INFO:teuthology.orchestra.run.trial194.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:13:39.955 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:39.956 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:39.956 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:13:39.956 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:39.956 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:39.956 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:39.977 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:13:39.981 INFO:teuthology.orchestra.run.trial114.stdout:(19/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2026-02-18T03:13:39.986 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:13:39.991 INFO:teuthology.orchestra.run.trial114.stdout:(20/95): libquadmath-11.5.0-14.el9.x86_64.rpm 800 kB/s | 184 kB 00:00 2026-02-18T03:13:39.992 INFO:teuthology.orchestra.run.trial194.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:13:39.995 INFO:teuthology.orchestra.run.trial194.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:13:40.000 INFO:teuthology.orchestra.run.trial194.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:13:40.016 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:40.018 INFO:teuthology.orchestra.run.trial097.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:40.023 INFO:teuthology.orchestra.run.trial194.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:13:40.025 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:13:40.035 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:13:40.038 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:17 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:13:40.039 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:13:40.045 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:13:40.047 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:13:40.048 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:13:40.048 INFO:teuthology.orchestra.run.trial114.stdout:(21/95): libgfortran-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 794 kB 00:00 2026-02-18T03:13:40.049 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:40.059 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:13:40.064 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:13:40.089 INFO:teuthology.orchestra.run.trial194.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:13:40.092 INFO:teuthology.orchestra.run.trial194.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:13:40.099 INFO:teuthology.orchestra.run.trial194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:13:40.100 INFO:teuthology.orchestra.run.trial114.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2026-02-18T03:13:40.119 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repository Size 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:13:40.120 INFO:teuthology.orchestra.run.trial119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:13:40.121 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:40.121 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:13:40.121 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:13:40.121 INFO:teuthology.orchestra.run.trial119.stdout:Install 5 Packages 2026-02-18T03:13:40.121 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:40.122 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 85 M 2026-02-18T03:13:40.122 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 364 M 2026-02-18T03:13:40.122 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:13:40.135 INFO:teuthology.orchestra.run.trial114.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 1.5 MB/s | 135 kB 00:00 2026-02-18T03:13:40.140 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:40.150 INFO:teuthology.orchestra.run.trial194.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:13:40.162 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:13:40.165 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:13:40.169 INFO:teuthology.orchestra.run.trial194.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:13:40.175 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:13:40.178 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:40.178 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:40.179 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:13:40.183 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:13:40.197 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:13:40.201 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:13:40.206 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:13:40.217 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:13:40.221 INFO:teuthology.orchestra.run.trial114.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 1.2 MB/s | 150 kB 00:00 2026-02-18T03:13:40.222 INFO:teuthology.orchestra.run.trial114.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 1.4 MB/s | 126 kB 00:00 2026-02-18T03:13:40.226 INFO:teuthology.orchestra.run.trial114.stdout:(26/95): python3-cryptography-36.0.1-5.el9.x86_ 5.1 MB/s | 1.2 MB 00:00 2026-02-18T03:13:40.227 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:13:40.233 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:13:40.252 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:13:40.263 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:13:40.279 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:13:40.284 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:13:40.291 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:13:40.313 INFO:teuthology.orchestra.run.trial114.stdout:(27/95): python3-urllib3-1.26.5-7.el9.noarch.rp 2.3 MB/s | 218 kB 00:00 2026-02-18T03:13:40.314 INFO:teuthology.orchestra.run.trial114.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 3.0 MB/s | 266 kB 00:00 2026-02-18T03:13:40.331 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:13:40.332 INFO:teuthology.orchestra.run.trial119.stdout:(1/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 1.4 MB/s | 164 kB 00:00 2026-02-18T03:13:40.350 INFO:teuthology.orchestra.run.trial114.stdout:(29/95): unzip-6.0-59.el9.x86_64.rpm 1.4 MB/s | 182 kB 00:00 2026-02-18T03:13:40.378 INFO:teuthology.orchestra.run.trial114.stdout:(30/95): flexiblas-3.0.4-9.el9.x86_64.rpm 457 kB/s | 30 kB 00:00 2026-02-18T03:13:40.416 INFO:teuthology.orchestra.run.trial114.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 223 kB/s | 15 kB 00:00 2026-02-18T03:13:40.464 INFO:teuthology.orchestra.run.trial114.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.8 MB/s | 246 kB 00:00 2026-02-18T03:13:40.484 INFO:teuthology.orchestra.run.trial114.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2026-02-18T03:13:40.487 INFO:teuthology.orchestra.run.trial114.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 1.8 MB/s | 42 kB 00:00 2026-02-18T03:13:40.515 INFO:teuthology.orchestra.run.trial114.stdout:(35/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 15 MB/s | 3.0 MB 00:00 2026-02-18T03:13:40.577 INFO:teuthology.orchestra.run.trial114.stdout:(36/95): python3-babel-2.9.1-2.el9.noarch.rpm 97 MB/s | 6.0 MB 00:00 2026-02-18T03:13:40.578 INFO:teuthology.orchestra.run.trial114.stdout:(37/95): protobuf-3.14.0-17.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2026-02-18T03:13:40.610 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:40.610 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:40.637 INFO:teuthology.orchestra.run.trial114.stdout:(38/95): python3-devel-3.9.25-2.el9.x86_64.rpm 4.0 MB/s | 244 kB 00:00 2026-02-18T03:13:40.638 INFO:teuthology.orchestra.run.trial114.stdout:(39/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 4.1 MB/s | 249 kB 00:00 2026-02-18T03:13:40.656 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:13:40.660 INFO:teuthology.orchestra.run.trial114.stdout:(40/95): python3-jmespath-1.0.1-1.el9.noarch.rp 2.0 MB/s | 48 kB 00:00 2026-02-18T03:13:40.663 INFO:teuthology.orchestra.run.trial114.stdout:(41/95): python3-libstoragemgmt-1.10.1-1.el9.x8 6.9 MB/s | 177 kB 00:00 2026-02-18T03:13:40.666 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:13:40.670 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:13:40.676 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:13:40.678 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:13:40.687 INFO:teuthology.orchestra.run.trial114.stdout:(42/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 26 MB/s | 5.3 MB 00:00 2026-02-18T03:13:40.687 INFO:teuthology.orchestra.run.trial114.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.4 MB/s | 35 kB 00:00 2026-02-18T03:13:40.706 INFO:teuthology.orchestra.run.trial194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:13:40.707 INFO:teuthology.orchestra.run.trial114.stdout:(44/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 26 MB/s | 1.2 MB 00:00 2026-02-18T03:13:40.749 INFO:teuthology.orchestra.run.trial194.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:13:40.756 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:13:40.760 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:13:40.765 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:13:40.768 INFO:teuthology.orchestra.run.trial114.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 1.2 MB/s | 77 kB 00:00 2026-02-18T03:13:40.769 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:13:40.770 INFO:teuthology.orchestra.run.trial114.stdout:(46/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.2 MB/s | 442 kB 00:00 2026-02-18T03:13:40.776 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:13:40.780 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:13:40.794 INFO:teuthology.orchestra.run.trial114.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 10 MB/s | 267 kB 00:00 2026-02-18T03:13:40.796 INFO:teuthology.orchestra.run.trial114.stdout:(48/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.2 MB/s | 159 kB 00:00 2026-02-18T03:13:40.807 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:13:40.817 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:13:40.820 INFO:teuthology.orchestra.run.trial114.stdout:(49/95): python3-requests-oauthlib-1.3.0-12.el9 2.1 MB/s | 54 kB 00:00 2026-02-18T03:13:40.821 INFO:teuthology.orchestra.run.trial114.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 10 MB/s | 279 kB 00:00 2026-02-18T03:13:40.823 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:13:40.830 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:13:40.844 INFO:teuthology.orchestra.run.trial114.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-18T03:13:40.864 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:13:40.866 INFO:teuthology.orchestra.run.trial114.stdout:(52/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 34 MB/s | 6.1 MB 00:00 2026-02-18T03:13:40.868 INFO:teuthology.orchestra.run.trial114.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.7 MB/s | 189 kB 00:00 2026-02-18T03:13:40.878 INFO:teuthology.orchestra.run.trial114.stdout:(54/95): lua-devel-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 22 kB 00:00 2026-02-18T03:13:40.897 INFO:teuthology.orchestra.run.trial114.stdout:(55/95): protobuf-compiler-3.14.0-17.el9.x86_64 44 MB/s | 862 kB 00:00 2026-02-18T03:13:40.903 INFO:teuthology.orchestra.run.trial114.stdout:(56/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 2.4 MB/s | 90 kB 00:00 2026-02-18T03:13:41.027 INFO:teuthology.orchestra.run.trial114.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 157 kB/s | 19 kB 00:00 2026-02-18T03:13:41.065 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:41.067 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:13:41.071 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:13:41.087 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:13:41.091 INFO:teuthology.orchestra.run.trial114.stdout:(58/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 71 MB/s | 19 MB 00:00 2026-02-18T03:13:41.092 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:13:41.095 INFO:teuthology.orchestra.run.trial119.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 266 kB/s | 233 kB 00:00 2026-02-18T03:13:41.110 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:13:41.114 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:13:41.125 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:13:41.134 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:13:41.139 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:13:41.142 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:13:41.146 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:13:41.169 INFO:teuthology.orchestra.run.trial078.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:13:41.172 INFO:teuthology.orchestra.run.trial194.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:13:41.174 INFO:teuthology.orchestra.run.trial114.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2026-02-18T03:13:41.174 INFO:teuthology.orchestra.run.trial194.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:13:41.180 INFO:teuthology.orchestra.run.trial114.stdout:(60/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.9 MB/s | 551 kB 00:00 2026-02-18T03:13:41.181 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:13:41.184 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:13:41.190 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:13:41.192 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:13:41.195 INFO:teuthology.orchestra.run.trial194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:13:41.199 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:41.203 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:13:41.204 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:41.209 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:13:41.218 INFO:teuthology.orchestra.run.trial114.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 661 kB/s | 29 kB 00:00 2026-02-18T03:13:41.224 INFO:teuthology.orchestra.run.trial114.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 1.4 MB/s | 60 kB 00:00 2026-02-18T03:13:41.232 INFO:teuthology.orchestra.run.trial078.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:13:41.235 INFO:teuthology.orchestra.run.trial078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:13:41.242 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:13:41.263 INFO:teuthology.orchestra.run.trial114.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 967 kB/s | 43 kB 00:00 2026-02-18T03:13:41.264 INFO:teuthology.orchestra.run.trial114.stdout:(64/95): python3-cachetools-4.2.4-1.el9.noarch. 799 kB/s | 32 kB 00:00 2026-02-18T03:13:41.274 INFO:teuthology.orchestra.run.trial119.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 322 kB/s | 303 kB 00:00 2026-02-18T03:13:41.292 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:13:41.304 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:13:41.305 INFO:teuthology.orchestra.run.trial114.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 339 kB/s | 14 kB 00:00 2026-02-18T03:13:41.307 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:13:41.309 INFO:teuthology.orchestra.run.trial114.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 3.8 MB/s | 173 kB 00:00 2026-02-18T03:13:41.311 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:13:41.317 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:13:41.321 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:13:41.324 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:13:41.334 INFO:teuthology.orchestra.run.trial119.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 267 kB/s | 64 kB 00:00 2026-02-18T03:13:41.338 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:13:41.342 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:13:41.347 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:13:41.354 INFO:teuthology.orchestra.run.trial114.stdout:(67/95): python3-google-auth-2.45.0-1.el9.noarc 5.5 MB/s | 254 kB 00:00 2026-02-18T03:13:41.358 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:13:41.367 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:13:41.373 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:13:41.379 INFO:teuthology.orchestra.run.trial114.stdout:(68/95): python3-asyncssh-2.13.2-5.el9.noarch.r 1.9 MB/s | 548 kB 00:00 2026-02-18T03:13:41.392 INFO:teuthology.orchestra.run.trial114.stdout:(69/95): python3-cherrypy-18.6.1-2.el9.noarch.r 4.0 MB/s | 358 kB 00:00 2026-02-18T03:13:41.393 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:13:41.403 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:13:41.419 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:13:41.423 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:13:41.426 INFO:teuthology.orchestra.run.trial114.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 3.0 MB/s | 144 kB 00:00 2026-02-18T03:13:41.431 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:13:41.438 INFO:teuthology.orchestra.run.trial114.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 3.0 MB/s | 139 kB 00:00 2026-02-18T03:13:41.470 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:13:41.471 INFO:teuthology.orchestra.run.trial114.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.2 MB/s | 56 kB 00:00 2026-02-18T03:13:41.480 INFO:teuthology.orchestra.run.trial114.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2026-02-18T03:13:41.490 INFO:teuthology.orchestra.run.trial114.stdout:(74/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 15 MB/s | 2.0 MB 00:00 2026-02-18T03:13:41.516 INFO:teuthology.orchestra.run.trial114.stdout:(75/95): python3-jaraco-classes-3.2.1-5.el9.noa 395 kB/s | 18 kB 00:00 2026-02-18T03:13:41.518 INFO:teuthology.orchestra.run.trial194.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:13:41.524 INFO:teuthology.orchestra.run.trial114.stdout:(76/95): python3-jaraco-collections-3.0.0-8.el9 524 kB/s | 23 kB 00:00 2026-02-18T03:13:41.532 INFO:teuthology.orchestra.run.trial114.stdout:(77/95): python3-jaraco-context-6.0.1-3.el9.noa 460 kB/s | 20 kB 00:00 2026-02-18T03:13:41.561 INFO:teuthology.orchestra.run.trial114.stdout:(78/95): python3-jaraco-functools-3.5.0-2.el9.n 439 kB/s | 19 kB 00:00 2026-02-18T03:13:41.568 INFO:teuthology.orchestra.run.trial114.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 603 kB/s | 26 kB 00:00 2026-02-18T03:13:41.588 INFO:teuthology.orchestra.run.trial114.stdout:(80/95): python3-kubernetes-26.1.0-3.el9.noarch 18 MB/s | 1.0 MB 00:00 2026-02-18T03:13:41.591 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:13:41.605 INFO:teuthology.orchestra.run.trial114.stdout:(81/95): python3-more-itertools-8.12.0-2.el9.no 1.7 MB/s | 79 kB 00:00 2026-02-18T03:13:41.611 INFO:teuthology.orchestra.run.trial114.stdout:(82/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2026-02-18T03:13:41.629 INFO:teuthology.orchestra.run.trial114.stdout:(83/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2026-02-18T03:13:41.648 INFO:teuthology.orchestra.run.trial114.stdout:(84/95): python3-portend-3.1.0-2.el9.noarch.rpm 388 kB/s | 16 kB 00:00 2026-02-18T03:13:41.653 INFO:teuthology.orchestra.run.trial114.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2026-02-18T03:13:41.656 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:41.658 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:41.669 INFO:teuthology.orchestra.run.trial114.stdout:(86/95): python3-repoze-lru-0.7-16.el9.noarch.r 766 kB/s | 31 kB 00:00 2026-02-18T03:13:41.672 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:41.673 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:41.691 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:41.693 INFO:teuthology.orchestra.run.trial114.stdout:(87/95): python3-routes-2.5.1-5.el9.noarch.rpm 4.1 MB/s | 188 kB 00:00 2026-02-18T03:13:41.696 INFO:teuthology.orchestra.run.trial114.stdout:(88/95): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2026-02-18T03:13:41.709 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:41.710 INFO:teuthology.orchestra.run.trial114.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 3.0 MB/s | 125 kB 00:00 2026-02-18T03:13:41.731 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:41.735 INFO:teuthology.orchestra.run.trial114.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 844 kB/s | 36 kB 00:00 2026-02-18T03:13:41.738 INFO:teuthology.orchestra.run.trial114.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 2.0 MB/s | 86 kB 00:00 2026-02-18T03:13:41.751 INFO:teuthology.orchestra.run.trial114.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2026-02-18T03:13:41.775 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:13:41.776 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:41.778 INFO:teuthology.orchestra.run.trial114.stdout:(93/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-18T03:13:41.783 INFO:teuthology.orchestra.run.trial114.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 497 kB/s | 22 kB 00:00 2026-02-18T03:13:41.788 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:13:41.792 INFO:teuthology.orchestra.run.trial114.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 492 kB/s | 20 kB 00:00 2026-02-18T03:13:41.792 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:41.792 INFO:teuthology.orchestra.run.trial114.stdout:Total 24 MB/s | 101 MB 00:04 2026-02-18T03:13:41.797 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:41.797 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:41.797 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:13:41.797 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:41.797 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:41.797 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:41.798 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:13:41.802 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:13:41.808 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:13:41.809 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:41.810 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:13:41.838 INFO:teuthology.orchestra.run.trial078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:13:41.880 INFO:teuthology.orchestra.run.trial078.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:13:41.887 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:13:41.890 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:13:41.896 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:13:41.899 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:13:41.906 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:13:41.910 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:13:41.937 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:13:41.946 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:13:41.952 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:13:41.959 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:13:41.993 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:13:42.029 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:42.031 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:42.037 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:42.037 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:13:42.037 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:13:42.037 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:13:42.037 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:13:42.052 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:42.052 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:42.052 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:13:42.053 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:42.053 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:42.053 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:42.089 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:13:42.089 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:42.089 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:13:42.089 INFO:teuthology.orchestra.run.trial031.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:42.089 INFO:teuthology.orchestra.run.trial031.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:42.089 INFO:teuthology.orchestra.run.trial031.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:13:42.089 INFO:teuthology.orchestra.run.trial031.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:13:42.089 INFO:teuthology.orchestra.run.trial031.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:13:42.090 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:42.090 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:13:42.124 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph 2026-02-18T03:13:42.149 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:42.171 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:42.171 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:42.171 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:13:42.171 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:42.171 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:42.171 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:42.189 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:42.213 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:13:42.230 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:13:42.236 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:13:42.240 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:13:42.266 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:13:42.266 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:13:42.266 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:13:42.284 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:13:42.295 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:13:42.297 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:13:42.299 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:13:42.301 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:13:42.316 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:13:42.320 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:13:42.331 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:13:42.406 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:13:42.415 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:13:42.432 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:25 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:13:42.438 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:13:42.468 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:13:42.519 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:13:42.521 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:13:42.521 INFO:teuthology.orchestra.run.trial031.stdout:====================================================================================== 2026-02-18T03:13:42.522 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repository Size 2026-02-18T03:13:42.522 INFO:teuthology.orchestra.run.trial031.stdout:====================================================================================== 2026-02-18T03:13:42.522 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:13:42.522 INFO:teuthology.orchestra.run.trial031.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:13:42.522 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-18T03:13:42.522 INFO:teuthology.orchestra.run.trial031.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:13:42.523 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:13:42.524 INFO:teuthology.orchestra.run.trial031.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:13:42.525 INFO:teuthology.orchestra.run.trial031.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:13:42.526 INFO:teuthology.orchestra.run.trial031.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:13:42.527 INFO:teuthology.orchestra.run.trial031.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:13:42.528 INFO:teuthology.orchestra.run.trial031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout:Installing weak dependencies: 2026-02-18T03:13:42.529 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout:====================================================================================== 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout:Install 95 Packages 2026-02-18T03:13:42.530 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:42.532 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:13:42.532 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:13:42.532 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 101 M 2026-02-18T03:13:42.532 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 561 M 2026-02-18T03:13:42.532 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:13:42.533 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:13:42.550 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:42.550 INFO:teuthology.orchestra.run.trial194.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:13:42.550 INFO:teuthology.orchestra.run.trial194.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:13:42.550 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:42.557 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:42.583 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:42.583 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:13:42.583 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:42.616 INFO:teuthology.orchestra.run.trial119.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 35 MB/s | 84 MB 00:02 2026-02-18T03:13:42.618 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:42.618 INFO:teuthology.orchestra.run.trial119.stdout:Total 34 MB/s | 85 MB 00:02 2026-02-18T03:13:42.620 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:13:42.640 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:13:42.645 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:13:42.656 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:13:42.656 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:13:42.683 INFO:teuthology.orchestra.run.trial194.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:13:42.685 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:42.698 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:13:42.699 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:13:42.700 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:42.700 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:42.700 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:13:42.700 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:42.712 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:13:42.858 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:42.858 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:13:42.858 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:13:42.858 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:13:42.858 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:13:42.858 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:13:42.858 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:13:42.859 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:13:42.860 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:13:42.861 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:13:42.862 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:13:42.863 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:13:42.864 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:13:42.865 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:13:42.866 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:13:42.866 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:13:42.920 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:13:42.920 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:13:42.922 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:13:42.923 INFO:teuthology.orchestra.run.trial097.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:13:42.924 INFO:teuthology.orchestra.run.trial097.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:13:42.925 INFO:teuthology.orchestra.run.trial097.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:13:42.926 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:13:42.927 INFO:teuthology.orchestra.run.trial097.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:42.928 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:42.944 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:13:42.945 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:13:42.979 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-base 2026-02-18T03:13:43.102 INFO:teuthology.orchestra.run.trial031.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 68 kB/s | 6.5 kB 00:00 2026-02-18T03:13:43.150 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:13:43.152 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:13:43.156 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:13:43.177 INFO:teuthology.orchestra.run.trial114.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:13:43.211 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:13:43.220 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:13:43.225 INFO:teuthology.orchestra.run.trial114.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:13:43.228 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:13:43.232 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:13:43.253 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:13:43.255 INFO:teuthology.orchestra.run.trial114.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:13:43.259 INFO:teuthology.orchestra.run.trial119.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:13:43.263 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:13:43.268 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:13:43.270 INFO:teuthology.orchestra.run.trial119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:13:43.271 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:43.272 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:13:43.278 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:13:43.280 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:13:43.292 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:13:43.298 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:13:43.300 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:43.322 INFO:teuthology.orchestra.run.trial114.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:13:43.325 INFO:teuthology.orchestra.run.trial114.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:13:43.332 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:13:43.364 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:43.373 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:13:43.381 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:43.382 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:43.382 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:43.382 INFO:teuthology.orchestra.run.trial114.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:13:43.385 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:43.390 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:13:43.395 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:13:43.398 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:13:43.400 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:13:43.402 INFO:teuthology.orchestra.run.trial114.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:13:43.404 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install cephadm 2026-02-18T03:13:43.407 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:13:43.408 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:13:43.410 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:43.410 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:43.410 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:13:43.410 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:43.410 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:43.410 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:43.412 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:13:43.415 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:13:43.419 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:13:43.430 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:13:43.434 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:13:43.435 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:13:43.439 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:13:43.450 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:13:43.460 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:13:43.466 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:13:43.471 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:43.473 INFO:teuthology.orchestra.run.trial194.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:43.480 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:13:43.485 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:13:43.497 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:13:43.503 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:13:43.505 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:43.509 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:13:43.512 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:13:43.517 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:13:43.517 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:13:43.525 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:13:43.540 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:13:43.544 INFO:teuthology.orchestra.run.trial031.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 1.7 MB/s | 961 kB 00:00 2026-02-18T03:13:43.565 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:13:43.569 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:13:43.619 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:13:43.628 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:13:43.631 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:13:43.632 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:13:43.651 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:43.651 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:13:43.651 INFO:teuthology.orchestra.run.trial078.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:13:43.651 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:43.660 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:43.687 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:43.687 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:13:43.687 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:43.713 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:43.721 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:13:43.777 INFO:teuthology.orchestra.run.trial097.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:43.783 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:13:43.785 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:43.794 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:43.795 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:43.795 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:43.800 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:43.800 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:43.801 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:13:43.801 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:43.816 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:13:43.870 INFO:teuthology.orchestra.run.trial031.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 2.7 MB/s | 2.3 MB 00:00 2026-02-18T03:13:43.881 INFO:teuthology.orchestra.run.trial031.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 3.7 MB/s | 43 kB 00:00 2026-02-18T03:13:43.887 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:13:43.897 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:13:43.902 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:13:43.904 INFO:teuthology.orchestra.run.trial031.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 7.6 MB/s | 173 kB 00:00 2026-02-18T03:13:43.907 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:13:43.909 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:13:43.937 INFO:teuthology.orchestra.run.trial114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:13:43.981 INFO:teuthology.orchestra.run.trial114.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:13:43.987 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:13:43.991 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:13:43.997 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:13:44.000 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:13:44.007 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:13:44.011 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:13:44.039 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:13:44.048 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:13:44.056 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:13:44.063 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:13:44.083 INFO:teuthology.orchestra.run.trial031.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 5.2 MB/s | 5.1 MB 00:00 2026-02-18T03:13:44.097 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:13:44.123 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:36 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 154 k 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 447 k 2026-02-18T03:13:44.205 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:44.323 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:13:44.346 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:13:44.350 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:13:44.409 INFO:teuthology.orchestra.run.trial114.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:13:44.411 INFO:teuthology.orchestra.run.trial114.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:13:44.432 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:13:44.462 INFO:teuthology.orchestra.run.trial097.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 600 kB/s | 154 kB 00:00 2026-02-18T03:13:44.463 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:44.463 INFO:teuthology.orchestra.run.trial097.stdout:Total 597 kB/s | 154 kB 00:00 2026-02-18T03:13:44.463 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:44.469 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:44.469 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:44.472 INFO:teuthology.orchestra.run.trial031.stdout:(7/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_6 18 MB/s | 17 MB 00:00 2026-02-18T03:13:44.474 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:44.485 INFO:teuthology.orchestra.run.trial031.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 1.7 MB/s | 22 kB 00:00 2026-02-18T03:13:44.500 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:44.500 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:44.500 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:13:44.500 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:44.500 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:44.500 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:44.501 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:44.502 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:44.513 INFO:teuthology.orchestra.run.trial031.stdout:(9/95): ceph-mgr-modules-core-20.2.0-670.gadc19 10 MB/s | 290 kB 00:00 2026-02-18T03:13:44.538 INFO:teuthology.orchestra.run.trial031.stdout:(10/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 2.0 MB/s | 50 kB 00:00 2026-02-18T03:13:44.547 INFO:teuthology.orchestra.run.trial031.stdout:(11/95): ceph-mgr-diskprediction-local-20.2.0-6 16 MB/s | 7.4 MB 00:00 2026-02-18T03:13:44.552 INFO:teuthology.orchestra.run.trial031.stdout:(12/95): ceph-prometheus-alerts-20.2.0-670.gadc 1.2 MB/s | 17 kB 00:00 2026-02-18T03:13:44.557 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:44.558 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:44.560 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:44.562 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:44.568 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:13:44.569 INFO:teuthology.orchestra.run.trial031.stdout:(13/95): ceph-mgr-dashboard-20.2.0-670.gadc1923 16 MB/s | 11 MB 00:00 2026-02-18T03:13:44.570 INFO:teuthology.orchestra.run.trial031.stdout:(14/95): ceph-volume-20.2.0-670.gadc19233.el9.n 13 MB/s | 297 kB 00:00 2026-02-18T03:13:44.581 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:44.581 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:44.581 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:13:44.581 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:44.583 INFO:teuthology.orchestra.run.trial031.stdout:(15/95): cephadm-20.2.0-670.gadc19233.el9.noarc 33 MB/s | 1.0 MB 00:00 2026-02-18T03:13:44.591 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:13:44.593 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:44.651 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:44.657 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:44.756 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:13:44.830 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:13:44.897 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:44.897 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:44.897 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:44.898 INFO:teuthology.orchestra.run.trial097.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:44.898 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:44.898 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:44.926 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr 2026-02-18T03:13:45.114 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:45.115 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:45.128 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:45.129 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:45.129 INFO:teuthology.orchestra.run.trial031.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 72 kB/s | 40 kB 00:00 2026-02-18T03:13:45.184 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:45.220 INFO:teuthology.orchestra.run.trial031.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 113 kB/s | 72 kB 00:00 2026-02-18T03:13:45.228 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:13:45.229 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:45.238 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:45.251 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:45.251 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:45.251 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:13:45.251 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:45.251 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:45.251 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:45.263 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:45.301 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:45.319 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:45.320 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:45.320 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:45.341 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:13:45.488 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:45.490 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:45.498 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:13:45.512 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:45.512 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:45.512 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:13:45.512 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:45.512 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:45.512 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:45.513 INFO:teuthology.orchestra.run.trial031.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 371 kB/s | 350 kB 00:00 2026-02-18T03:13:45.516 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:13:45.526 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:13:45.533 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:13:45.537 INFO:teuthology.orchestra.run.trial031.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 583 kB/s | 184 kB 00:00 2026-02-18T03:13:45.546 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:13:45.562 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:13:45.610 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:45.630 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:45.630 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:45.630 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:13:45.631 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:45.631 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:45.631 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:45.637 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:13:45.646 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:13:45.648 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:45.655 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:45.670 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:13:45.699 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:13:45.719 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:45.735 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:45.737 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:45.737 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:45.737 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:45.741 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:45.750 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:13:45.756 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:13:45.759 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:13:45.760 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:13:45.761 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:13:45.779 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:45.779 INFO:teuthology.orchestra.run.trial114.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:13:45.779 INFO:teuthology.orchestra.run.trial114.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:13:45.779 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:45.788 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:45.815 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:45.815 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:13:45.815 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:45.850 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:13:45.905 INFO:teuthology.orchestra.run.trial031.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 645 kB/s | 253 kB 00:00 2026-02-18T03:13:45.913 INFO:teuthology.orchestra.run.trial114.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:13:45.915 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:45.929 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:45.929 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:45.929 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:13:45.929 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:46.070 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:46.134 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:46.141 INFO:teuthology.orchestra.run.trial031.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 451 kB/s | 106 kB 00:00 2026-02-18T03:13:46.152 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:46.152 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:46.152 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:46.174 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:13:46.190 INFO:teuthology.orchestra.run.trial031.stdout:(22/95): libgfortran-11.5.0-14.el9.x86_64.rpm 748 kB/s | 794 kB 00:01 2026-02-18T03:13:46.191 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:46.192 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:46.206 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:46.206 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:46.263 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:13:46.294 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:13:46.295 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:13:46.296 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:13:46.296 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:13:46.296 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:13:46.296 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:13:46.296 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:13:46.297 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:13:46.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:13:46.306 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:13:46.307 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:46.329 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:46.329 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:46.329 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:13:46.329 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:46.329 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:46.329 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:46.341 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:46.362 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:13:46.362 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:46.362 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:46.362 INFO:teuthology.orchestra.run.trial194.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:13:46.362 INFO:teuthology.orchestra.run.trial194.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:46.362 INFO:teuthology.orchestra.run.trial194.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.362 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.363 INFO:teuthology.orchestra.run.trial194.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:46.364 INFO:teuthology.orchestra.run.trial194.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:13:46.365 INFO:teuthology.orchestra.run.trial194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:13:46.366 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:13:46.367 INFO:teuthology.orchestra.run.trial194.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:13:46.368 INFO:teuthology.orchestra.run.trial194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:13:46.369 INFO:teuthology.orchestra.run.trial194.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:13:46.370 INFO:teuthology.orchestra.run.trial194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:13:46.370 INFO:teuthology.orchestra.run.trial194.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:13:46.370 INFO:teuthology.orchestra.run.trial194.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:13:46.370 INFO:teuthology.orchestra.run.trial194.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:13:46.370 INFO:teuthology.orchestra.run.trial194.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:13:46.370 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:46.370 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:46.378 INFO:teuthology.orchestra.run.trial031.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 571 kB/s | 135 kB 00:00 2026-02-18T03:13:46.416 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-base 2026-02-18T03:13:46.482 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:46.506 INFO:teuthology.orchestra.run.trial031.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 477 kB/s | 150 kB 00:00 2026-02-18T03:13:46.546 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:46.562 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:46.564 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:46.564 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:46.565 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:46.565 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:46.586 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:13:46.587 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:46.587 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:46.587 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:13:46.587 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:46.587 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:46.587 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:46.614 INFO:teuthology.orchestra.run.trial031.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 536 kB/s | 126 kB 00:00 2026-02-18T03:13:46.616 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:46.641 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:46.641 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:46.641 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:13:46.641 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:46.642 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:46.642 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:46.683 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:46.702 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:46.704 INFO:teuthology.orchestra.run.trial114.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:46.705 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:46.705 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:46.705 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:13:46.705 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:46.705 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:46.705 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:46.711 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:13:46.724 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:46.724 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:46.734 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:13:46.736 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:46.787 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:46.806 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:46.807 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:46.807 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:46.827 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install cephadm 2026-02-18T03:13:46.896 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:46.900 INFO:teuthology.orchestra.run.trial031.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 553 kB/s | 218 kB 00:00 2026-02-18T03:13:46.927 INFO:teuthology.orchestra.run.trial031.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 580 kB/s | 182 kB 00:00 2026-02-18T03:13:46.959 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:46.970 INFO:teuthology.orchestra.run.trial031.stdout:(28/95): flexiblas-3.0.4-9.el9.x86_64.rpm 687 kB/s | 30 kB 00:00 2026-02-18T03:13:46.976 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:46.977 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:46.977 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:46.998 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-fuse 2026-02-18T03:13:47.101 INFO:teuthology.orchestra.run.trial031.stdout:(29/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 23 MB/s | 3.0 MB 00:00 2026-02-18T03:13:47.112 INFO:teuthology.orchestra.run.trial031.stdout:(30/95): python3-cryptography-36.0.1-5.el9.x86_ 810 kB/s | 1.2 MB 00:01 2026-02-18T03:13:47.123 INFO:teuthology.orchestra.run.trial031.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 684 kB/s | 15 kB 00:00 2026-02-18T03:13:47.135 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:47.146 INFO:teuthology.orchestra.run.trial031.stdout:(32/95): lua-5.4.4-4.el9.x86_64.rpm 7.9 MB/s | 188 kB 00:00 2026-02-18T03:13:47.168 INFO:teuthology.orchestra.run.trial031.stdout:(33/95): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-18T03:13:47.169 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:13:47.187 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:47.197 INFO:teuthology.orchestra.run.trial031.stdout:(34/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.8 MB/s | 246 kB 00:00 2026-02-18T03:13:47.198 INFO:teuthology.orchestra.run.trial194.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:47.216 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:47.216 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:47.217 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:47.221 INFO:teuthology.orchestra.run.trial031.stdout:(35/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 100 MB/s | 5.3 MB 00:00 2026-02-18T03:13:47.238 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:13:47.277 INFO:teuthology.orchestra.run.trial031.stdout:(36/95): python3-babel-2.9.1-2.el9.noarch.rpm 107 MB/s | 6.0 MB 00:00 2026-02-18T03:13:47.279 INFO:teuthology.orchestra.run.trial031.stdout:(37/95): protobuf-3.14.0-17.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2026-02-18T03:13:47.291 INFO:teuthology.orchestra.run.trial031.stdout:(38/95): zip-3.0-35.el9.x86_64.rpm 680 kB/s | 266 kB 00:00 2026-02-18T03:13:47.301 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:47.302 INFO:teuthology.orchestra.run.trial031.stdout:(39/95): python3-devel-3.9.25-2.el9.x86_64.rpm 9.7 MB/s | 244 kB 00:00 2026-02-18T03:13:47.304 INFO:teuthology.orchestra.run.trial031.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.8 MB/s | 249 kB 00:00 2026-02-18T03:13:47.326 INFO:teuthology.orchestra.run.trial031.stdout:(41/95): python3-libstoragemgmt-1.10.1-1.el9.x8 7.1 MB/s | 177 kB 00:00 2026-02-18T03:13:47.348 INFO:teuthology.orchestra.run.trial031.stdout:(42/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-18T03:13:47.350 INFO:teuthology.orchestra.run.trial031.stdout:(43/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 26 MB/s | 1.2 MB 00:00 2026-02-18T03:13:47.355 INFO:teuthology.orchestra.run.trial031.stdout:(44/95): python3-jmespath-1.0.1-1.el9.noarch.rp 744 kB/s | 48 kB 00:00 2026-02-18T03:13:47.378 INFO:teuthology.orchestra.run.trial031.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-18T03:13:47.378 INFO:teuthology.orchestra.run.trial031.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-18T03:13:47.379 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:47.379 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:13:47.379 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:13:47.379 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:13:47.379 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:13:47.379 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:13:47.380 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:13:47.381 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:13:47.382 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:13:47.383 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:13:47.384 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:13:47.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:13:47.386 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:13:47.387 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:47.387 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:47.388 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 942 k 2026-02-18T03:13:47.389 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 2.7 M 2026-02-18T03:13:47.389 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:47.404 INFO:teuthology.orchestra.run.trial031.stdout:(47/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 110 MB/s | 6.1 MB 00:00 2026-02-18T03:13:47.405 INFO:teuthology.orchestra.run.trial031.stdout:(48/95): python3-protobuf-3.14.0-17.el9.noarch. 9.0 MB/s | 267 kB 00:00 2026-02-18T03:13:47.422 INFO:teuthology.orchestra.run.trial031.stdout:(49/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.5 MB/s | 159 kB 00:00 2026-02-18T03:13:47.428 INFO:teuthology.orchestra.run.trial031.stdout:(50/95): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-18T03:13:47.429 INFO:teuthology.orchestra.run.trial031.stdout:(51/95): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-18T03:13:47.441 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:13:47.441 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:47.441 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:47.441 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:47.442 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:13:47.443 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:13:47.444 INFO:teuthology.orchestra.run.trial078.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:13:47.445 INFO:teuthology.orchestra.run.trial078.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:13:47.446 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:13:47.447 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:13:47.448 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:13:47.449 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:13:47.449 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:13:47.449 INFO:teuthology.orchestra.run.trial078.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:13:47.449 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:13:47.449 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:13:47.449 INFO:teuthology.orchestra.run.trial078.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:13:47.449 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:47.449 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:47.450 INFO:teuthology.orchestra.run.trial031.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-18T03:13:47.452 INFO:teuthology.orchestra.run.trial031.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.8 MB/s | 189 kB 00:00 2026-02-18T03:13:47.473 INFO:teuthology.orchestra.run.trial031.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.9 MB/s | 90 kB 00:00 2026-02-18T03:13:47.498 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-base 2026-02-18T03:13:47.510 INFO:teuthology.orchestra.run.trial097.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 7.3 MB/s | 942 kB 00:00 2026-02-18T03:13:47.511 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:47.511 INFO:teuthology.orchestra.run.trial097.stdout:Total 7.2 MB/s | 942 kB 00:00 2026-02-18T03:13:47.511 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:47.516 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:47.516 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:47.541 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:13:47.542 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:13:47.542 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:13:47.542 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:13:47.542 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:13:47.546 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:47.549 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:47.549 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:47.594 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:13:47.594 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:47.594 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:13:47.594 INFO:teuthology.orchestra.run.trial119.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:47.594 INFO:teuthology.orchestra.run.trial119.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:47.594 INFO:teuthology.orchestra.run.trial119.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:13:47.595 INFO:teuthology.orchestra.run.trial119.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:13:47.595 INFO:teuthology.orchestra.run.trial119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:13:47.595 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:47.595 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:13:47.627 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:47.628 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:47.628 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-18T03:13:47.628 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:47.628 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 154 k 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 447 k 2026-02-18T03:13:47.629 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:47.631 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph 2026-02-18T03:13:47.638 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:47.655 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:47.693 INFO:teuthology.orchestra.run.trial031.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 93 kB/s | 22 kB 00:00 2026-02-18T03:13:47.713 INFO:teuthology.orchestra.run.trial194.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 1.8 MB/s | 154 kB 00:00 2026-02-18T03:13:47.714 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:47.714 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.8 MB/s | 154 kB 00:00 2026-02-18T03:13:47.714 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:47.718 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:47.719 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:47.751 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:47.751 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:47.806 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:47.807 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:47.811 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:47.830 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:47.830 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:47.830 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:13:47.830 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:47.875 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:47.877 INFO:teuthology.orchestra.run.trial031.stdout:(56/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 42 MB/s | 19 MB 00:00 2026-02-18T03:13:47.892 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:47.893 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:47.894 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:47.894 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:47.898 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:47.904 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:47.915 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install cephadm 2026-02-18T03:13:47.939 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:24 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:13:47.950 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:47.950 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:47.950 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:47.950 INFO:teuthology.orchestra.run.trial097.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:47.950 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:47.950 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:47.979 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-volume 2026-02-18T03:13:48.024 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:13:48.027 INFO:teuthology.orchestra.run.trial119.stdout:====================================================================================== 2026-02-18T03:13:48.027 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repository Size 2026-02-18T03:13:48.027 INFO:teuthology.orchestra.run.trial119.stdout:====================================================================================== 2026-02-18T03:13:48.027 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:13:48.027 INFO:teuthology.orchestra.run.trial119.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:13:48.027 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-18T03:13:48.027 INFO:teuthology.orchestra.run.trial119.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:13:48.027 INFO:teuthology.orchestra.run.trial119.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:13:48.028 INFO:teuthology.orchestra.run.trial119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:13:48.029 INFO:teuthology.orchestra.run.trial119.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:13:48.030 INFO:teuthology.orchestra.run.trial119.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:13:48.031 INFO:teuthology.orchestra.run.trial119.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:13:48.032 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:13:48.033 INFO:teuthology.orchestra.run.trial119.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout:Installing weak dependencies: 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:13:48.034 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout:====================================================================================== 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout:Install 95 Packages 2026-02-18T03:13:48.035 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:48.036 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 101 M 2026-02-18T03:13:48.036 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 561 M 2026-02-18T03:13:48.036 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:13:48.113 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:48.113 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:48.113 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:48.113 INFO:teuthology.orchestra.run.trial194.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:48.113 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:48.113 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:48.114 INFO:teuthology.orchestra.run.trial031.stdout:(57/95): protobuf-compiler-3.14.0-17.el9.x86_64 1.3 MB/s | 862 kB 00:00 2026-02-18T03:13:48.120 INFO:teuthology.orchestra.run.trial031.stdout:(58/95): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2026-02-18T03:13:48.141 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr 2026-02-18T03:13:48.169 INFO:teuthology.orchestra.run.trial031.stdout:(59/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-18T03:13:48.226 INFO:teuthology.orchestra.run.trial031.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 514 kB/s | 29 kB 00:00 2026-02-18T03:13:48.228 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:48.286 INFO:teuthology.orchestra.run.trial031.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 1.0 MB/s | 60 kB 00:00 2026-02-18T03:13:48.289 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:48.291 INFO:teuthology.orchestra.run.trial078.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:48.308 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:48.309 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:48.309 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:48.330 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:13:48.344 INFO:teuthology.orchestra.run.trial031.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 745 kB/s | 43 kB 00:00 2026-02-18T03:13:48.353 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:48.364 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:48.365 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:48.370 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:48.371 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:48.371 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:48.378 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:48.379 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:48.392 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librados-devel 2026-02-18T03:13:48.402 INFO:teuthology.orchestra.run.trial031.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 562 kB/s | 32 kB 00:00 2026-02-18T03:13:48.431 INFO:teuthology.orchestra.run.trial031.stdout:(64/95): python3-asyncssh-2.13.2-5.el9.noarch.r 1.7 MB/s | 548 kB 00:00 2026-02-18T03:13:48.434 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:48.446 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:48.458 INFO:teuthology.orchestra.run.trial031.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 251 kB/s | 14 kB 00:00 2026-02-18T03:13:48.478 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:13:48.480 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:48.497 INFO:teuthology.orchestra.run.trial031.stdout:(66/95): luarocks-3.9.2-5.el9.noarch.rpm 394 kB/s | 151 kB 00:00 2026-02-18T03:13:48.501 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:48.501 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:48.501 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:13:48.501 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:48.501 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:48.501 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:48.502 INFO:teuthology.orchestra.run.trial031.stdout:(67/95): python3-cheroot-10.0.1-4.el9.noarch.rp 2.4 MB/s | 173 kB 00:00 2026-02-18T03:13:48.510 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:48.513 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:48.527 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:48.528 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:48.528 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:48.538 INFO:teuthology.orchestra.run.trial031.stdout:(68/95): python3-cherrypy-18.6.1-2.el9.noarch.r 4.4 MB/s | 358 kB 00:00 2026-02-18T03:13:48.549 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:13:48.602 INFO:teuthology.orchestra.run.trial031.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 2.2 MB/s | 144 kB 00:00 2026-02-18T03:13:48.636 INFO:teuthology.orchestra.run.trial031.stdout:(70/95): python3-google-auth-2.45.0-1.el9.noarc 1.8 MB/s | 254 kB 00:00 2026-02-18T03:13:48.645 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:48.667 INFO:teuthology.orchestra.run.trial031.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 2.1 MB/s | 139 kB 00:00 2026-02-18T03:13:48.692 INFO:teuthology.orchestra.run.trial031.stdout:(72/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2026-02-18T03:13:48.700 INFO:teuthology.orchestra.run.trial031.stdout:(73/95): python3-isodate-0.6.1-3.el9.noarch.rpm 871 kB/s | 56 kB 00:00 2026-02-18T03:13:48.702 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:48.723 INFO:teuthology.orchestra.run.trial031.stdout:(74/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 191 kB/s | 11 kB 00:00 2026-02-18T03:13:48.727 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:48.728 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:48.728 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-18T03:13:48.728 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:48.728 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:48.728 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:13:48.728 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:48.729 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:48.729 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:48.729 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-18T03:13:48.729 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:48.729 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 154 k 2026-02-18T03:13:48.729 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 447 k 2026-02-18T03:13:48.729 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:48.745 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:48.746 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:48.752 INFO:teuthology.orchestra.run.trial031.stdout:(75/95): python3-jaraco-classes-3.2.1-5.el9.noa 295 kB/s | 18 kB 00:00 2026-02-18T03:13:48.761 INFO:teuthology.orchestra.run.trial031.stdout:(76/95): python3-jaraco-collections-3.0.0-8.el9 381 kB/s | 23 kB 00:00 2026-02-18T03:13:48.768 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:48.768 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:48.768 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:13:48.769 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:48.769 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:48.769 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:48.779 INFO:teuthology.orchestra.run.trial031.stdout:(77/95): python3-jaraco-context-6.0.1-3.el9.noa 349 kB/s | 20 kB 00:00 2026-02-18T03:13:48.784 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:48.784 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:48.784 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 126 k 2026-02-18T03:13:48.785 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 449 k 2026-02-18T03:13:48.786 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:48.797 INFO:teuthology.orchestra.run.trial119.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 30 kB/s | 6.5 kB 00:00 2026-02-18T03:13:48.811 INFO:teuthology.orchestra.run.trial031.stdout:(78/95): python3-jaraco-functools-3.5.0-2.el9.n 325 kB/s | 19 kB 00:00 2026-02-18T03:13:48.822 INFO:teuthology.orchestra.run.trial031.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 432 kB/s | 26 kB 00:00 2026-02-18T03:13:48.858 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:48.867 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:48.872 INFO:teuthology.orchestra.run.trial031.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2026-02-18T03:13:48.888 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:48.888 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:48.888 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:13:48.888 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:48.888 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:48.888 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:48.891 INFO:teuthology.orchestra.run.trial031.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2026-02-18T03:13:48.906 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:48.907 INFO:teuthology.orchestra.run.trial031.stdout:(82/95): python3-kubernetes-26.1.0-3.el9.noarch 8.0 MB/s | 1.0 MB 00:00 2026-02-18T03:13:48.921 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:48.932 INFO:teuthology.orchestra.run.trial031.stdout:(83/95): python3-natsort-7.1.1-5.el9.noarch.rpm 955 kB/s | 58 kB 00:00 2026-02-18T03:13:48.939 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:48.940 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:48.940 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:48.951 INFO:teuthology.orchestra.run.trial031.stdout:(84/95): python3-portend-3.1.0-2.el9.noarch.rpm 272 kB/s | 16 kB 00:00 2026-02-18T03:13:48.960 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:13:48.965 INFO:teuthology.orchestra.run.trial031.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2026-02-18T03:13:48.992 INFO:teuthology.orchestra.run.trial031.stdout:(86/95): python3-repoze-lru-0.7-16.el9.noarch.r 514 kB/s | 31 kB 00:00 2026-02-18T03:13:49.022 INFO:teuthology.orchestra.run.trial031.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2026-02-18T03:13:49.032 INFO:teuthology.orchestra.run.trial031.stdout:(88/95): python3-routes-2.5.1-5.el9.noarch.rpm 2.3 MB/s | 188 kB 00:00 2026-02-18T03:13:49.054 INFO:teuthology.orchestra.run.trial031.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 2.0 MB/s | 125 kB 00:00 2026-02-18T03:13:49.078 INFO:teuthology.orchestra.run.trial031.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 637 kB/s | 36 kB 00:00 2026-02-18T03:13:49.097 INFO:teuthology.orchestra.run.trial078.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 417 kB/s | 154 kB 00:00 2026-02-18T03:13:49.097 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:49.097 INFO:teuthology.orchestra.run.trial078.stdout:Total 416 kB/s | 154 kB 00:00 2026-02-18T03:13:49.097 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:49.100 INFO:teuthology.orchestra.run.trial031.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 1.2 MB/s | 86 kB 00:00 2026-02-18T03:13:49.103 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:49.103 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:49.115 INFO:teuthology.orchestra.run.trial031.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-18T03:13:49.134 INFO:teuthology.orchestra.run.trial031.stdout:(93/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 862 kB/s | 48 kB 00:00 2026-02-18T03:13:49.135 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:49.135 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:49.162 INFO:teuthology.orchestra.run.trial031.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 356 kB/s | 22 kB 00:00 2026-02-18T03:13:49.162 INFO:teuthology.orchestra.run.trial097.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 333 kB/s | 126 kB 00:00 2026-02-18T03:13:49.163 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:49.163 INFO:teuthology.orchestra.run.trial097.stdout:Total 332 kB/s | 126 kB 00:00 2026-02-18T03:13:49.163 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:49.166 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:49.166 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:49.175 INFO:teuthology.orchestra.run.trial031.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 334 kB/s | 20 kB 00:00 2026-02-18T03:13:49.181 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:49.181 INFO:teuthology.orchestra.run.trial031.stdout:Total 15 MB/s | 101 MB 00:06 2026-02-18T03:13:49.192 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:49.194 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:49.198 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:49.198 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:49.216 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:49.216 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:49.216 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:13:49.216 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:49.252 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:49.268 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:49.268 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:49.332 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:49.350 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:49.350 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:49.350 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:49.352 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:49.372 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:13:49.407 INFO:teuthology.orchestra.run.trial119.stdout:(2/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 2.8 MB/s | 2.3 MB 00:00 2026-02-18T03:13:49.409 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:49.410 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:49.410 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:49.410 INFO:teuthology.orchestra.run.trial097.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:49.410 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:49.410 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:49.436 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install libcephfs2 2026-02-18T03:13:49.500 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:49.501 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:49.501 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:49.501 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:49.501 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:49.501 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:49.513 INFO:teuthology.orchestra.run.trial119.stdout:(3/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 1.0 MB/s | 961 kB 00:00 2026-02-18T03:13:49.528 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr 2026-02-18T03:13:49.569 INFO:teuthology.orchestra.run.trial119.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 781 kB/s | 43 kB 00:00 2026-02-18T03:13:49.597 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:13:49.609 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:13:49.610 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:13:49.611 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:13:49.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:13:49.613 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:13:49.614 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:13:49.615 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:13:49.616 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:13:49.635 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:13:49.635 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:13:49.676 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:13:49.676 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:49.676 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:13:49.678 INFO:teuthology.orchestra.run.trial114.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:13:49.679 INFO:teuthology.orchestra.run.trial114.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:13:49.680 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:49.681 INFO:teuthology.orchestra.run.trial114.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:13:49.682 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:13:49.683 INFO:teuthology.orchestra.run.trial114.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:49.684 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:49.685 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:49.732 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-base 2026-02-18T03:13:49.740 INFO:teuthology.orchestra.run.trial119.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 1.0 MB/s | 173 kB 00:00 2026-02-18T03:13:49.742 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:49.745 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:49.762 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:49.763 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:49.763 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:49.783 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:13:49.806 INFO:teuthology.orchestra.run.trial097.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:49.824 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:49.824 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:49.824 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:49.844 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:49.846 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install libcephfs-devel 2026-02-18T03:13:49.868 INFO:teuthology.orchestra.run.trial119.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 4.7 MB/s | 5.1 MB 00:01 2026-02-18T03:13:49.909 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:49.926 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:49.927 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:49.927 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:49.948 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:13:50.048 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:34 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:50.070 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:13:50.070 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:13:50.095 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:50.112 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:50.130 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:50.130 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:50.131 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:50.153 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install cephadm 2026-02-18T03:13:50.156 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:50.158 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:50.175 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:50.176 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:50.176 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:50.196 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-fuse 2026-02-18T03:13:50.237 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:50.238 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:50.238 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-18T03:13:50.238 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:50.238 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 34 k 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 155 k 2026-02-18T03:13:50.239 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:50.257 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:50.321 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:50.339 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:50.339 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:50.339 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:50.360 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:13:50.466 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:34 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:50.483 INFO:teuthology.orchestra.run.trial097.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 140 kB/s | 34 kB 00:00 2026-02-18T03:13:50.484 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:50.484 INFO:teuthology.orchestra.run.trial097.stdout:Total 140 kB/s | 34 kB 00:00 2026-02-18T03:13:50.484 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:50.486 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:50.486 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:50.488 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:50.488 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:50.506 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:50.509 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:50.525 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:50.529 INFO:teuthology.orchestra.run.trial114.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:50.530 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:13:50.533 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:13:50.537 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:13:50.543 INFO:teuthology.orchestra.run.trial119.stdout:(7/95): ceph-mgr-diskprediction-local-20.2.0-67 11 MB/s | 7.4 MB 00:00 2026-02-18T03:13:50.547 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:50.548 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:50.548 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:50.558 INFO:teuthology.orchestra.run.trial031.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:13:50.565 INFO:teuthology.orchestra.run.trial119.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 1.0 MB/s | 22 kB 00:00 2026-02-18T03:13:50.569 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:13:50.580 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:50.587 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:50.588 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:50.588 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:50.588 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 942 k 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 2.7 M 2026-02-18T03:13:50.589 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:50.591 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:13:50.597 INFO:teuthology.orchestra.run.trial119.stdout:(9/95): ceph-mgr-modules-core-20.2.0-670.gadc19 8.7 MB/s | 290 kB 00:00 2026-02-18T03:13:50.601 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:13:50.606 INFO:teuthology.orchestra.run.trial031.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:13:50.608 INFO:teuthology.orchestra.run.trial031.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:13:50.613 INFO:teuthology.orchestra.run.trial031.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:13:50.623 INFO:teuthology.orchestra.run.trial119.stdout:(10/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 1.9 MB/s | 50 kB 00:00 2026-02-18T03:13:50.636 INFO:teuthology.orchestra.run.trial031.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:13:50.637 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:50.637 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:50.637 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:50.637 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:50.637 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:50.637 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:50.649 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:13:50.651 INFO:teuthology.orchestra.run.trial119.stdout:(11/95): ceph-prometheus-alerts-20.2.0-670.gadc 614 kB/s | 17 kB 00:00 2026-02-18T03:13:50.652 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:13:50.658 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:13:50.659 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:13:50.664 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librados2 2026-02-18T03:13:50.670 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:13:50.672 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:50.676 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:13:50.687 INFO:teuthology.orchestra.run.trial119.stdout:(12/95): ceph-volume-20.2.0-670.gadc19233.el9.n 8.1 MB/s | 297 kB 00:00 2026-02-18T03:13:50.700 INFO:teuthology.orchestra.run.trial031.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:13:50.704 INFO:teuthology.orchestra.run.trial031.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:13:50.710 INFO:teuthology.orchestra.run.trial119.stdout:(13/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 13 MB/s | 17 MB 00:01 2026-02-18T03:13:50.711 INFO:teuthology.orchestra.run.trial031.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:13:50.727 INFO:teuthology.orchestra.run.trial119.stdout:(14/95): cephadm-20.2.0-670.gadc19233.el9.noarc 25 MB/s | 1.0 MB 00:00 2026-02-18T03:13:50.732 INFO:teuthology.orchestra.run.trial119.stdout:(15/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 16 MB/s | 350 kB 00:00 2026-02-18T03:13:50.737 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:50.738 INFO:teuthology.orchestra.run.trial119.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 3.8 MB/s | 40 kB 00:00 2026-02-18T03:13:50.754 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:50.755 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:50.755 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:50.756 INFO:teuthology.orchestra.run.trial119.stdout:(17/95): libgfortran-11.5.0-14.el9.x86_64.rpm 42 MB/s | 794 kB 00:00 2026-02-18T03:13:50.761 INFO:teuthology.orchestra.run.trial031.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:13:50.762 INFO:teuthology.orchestra.run.trial119.stdout:(18/95): libquadmath-11.5.0-14.el9.x86_64.rpm 31 MB/s | 184 kB 00:00 2026-02-18T03:13:50.769 INFO:teuthology.orchestra.run.trial119.stdout:(19/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 36 MB/s | 253 kB 00:00 2026-02-18T03:13:50.773 INFO:teuthology.orchestra.run.trial119.stdout:(20/95): libconfig-1.7.2-9.el9.x86_64.rpm 1.7 MB/s | 72 kB 00:00 2026-02-18T03:13:50.774 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:13:50.777 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:13:50.778 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:13:50.779 INFO:teuthology.orchestra.run.trial119.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 20 MB/s | 106 kB 00:00 2026-02-18T03:13:50.781 INFO:teuthology.orchestra.run.trial031.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:13:50.782 INFO:teuthology.orchestra.run.trial119.stdout:(22/95): python3-cryptography-36.0.1-5.el9.x86_ 99 MB/s | 1.2 MB 00:00 2026-02-18T03:13:50.785 INFO:teuthology.orchestra.run.trial119.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 19 MB/s | 135 kB 00:00 2026-02-18T03:13:50.786 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:13:50.789 INFO:teuthology.orchestra.run.trial119.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 22 MB/s | 150 kB 00:00 2026-02-18T03:13:50.790 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:13:50.791 INFO:teuthology.orchestra.run.trial119.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 20 MB/s | 126 kB 00:00 2026-02-18T03:13:50.793 INFO:teuthology.orchestra.run.trial194.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 4.5 MB/s | 942 kB 00:00 2026-02-18T03:13:50.794 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:13:50.794 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:50.794 INFO:teuthology.orchestra.run.trial194.stdout:Total 4.5 MB/s | 942 kB 00:00 2026-02-18T03:13:50.794 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:50.797 INFO:teuthology.orchestra.run.trial119.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 25 MB/s | 218 kB 00:00 2026-02-18T03:13:50.798 INFO:teuthology.orchestra.run.trial119.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 28 MB/s | 182 kB 00:00 2026-02-18T03:13:50.798 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:50.799 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:50.803 INFO:teuthology.orchestra.run.trial119.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 42 MB/s | 266 kB 00:00 2026-02-18T03:13:50.808 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:13:50.812 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:13:50.817 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:13:50.826 INFO:teuthology.orchestra.run.trial119.stdout:(29/95): flexiblas-3.0.4-9.el9.x86_64.rpm 1.0 MB/s | 30 kB 00:00 2026-02-18T03:13:50.829 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:13:50.832 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:50.832 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:50.835 INFO:teuthology.orchestra.run.trial119.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-9.el9. 1.7 MB/s | 15 kB 00:00 2026-02-18T03:13:50.838 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:13:50.844 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:13:50.864 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:13:50.865 INFO:teuthology.orchestra.run.trial119.stdout:(31/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 7.9 MB/s | 246 kB 00:00 2026-02-18T03:13:50.875 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:13:50.879 INFO:teuthology.orchestra.run.trial119.stdout:(32/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 40 MB/s | 3.0 MB 00:00 2026-02-18T03:13:50.879 INFO:teuthology.orchestra.run.trial119.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 13 MB/s | 188 kB 00:00 2026-02-18T03:13:50.880 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:34 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:50.888 INFO:teuthology.orchestra.run.trial119.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 4.8 MB/s | 42 kB 00:00 2026-02-18T03:13:50.890 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:13:50.895 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:13:50.900 INFO:teuthology.orchestra.run.trial119.stdout:(35/95): protobuf-3.14.0-17.el9.x86_64.rpm 84 MB/s | 1.0 MB 00:00 2026-02-18T03:13:50.903 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:13:50.922 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:50.940 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:50.942 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:13:50.946 INFO:teuthology.orchestra.run.trial119.stdout:(36/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 79 MB/s | 5.3 MB 00:00 2026-02-18T03:13:50.961 INFO:teuthology.orchestra.run.trial119.stdout:(37/95): python3-babel-2.9.1-2.el9.noarch.rpm 97 MB/s | 6.0 MB 00:00 2026-02-18T03:13:50.962 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:50.962 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:50.963 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 154 k 2026-02-18T03:13:50.964 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 447 k 2026-02-18T03:13:50.964 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:13:50.964 INFO:teuthology.orchestra.run.trial119.stdout:(38/95): python3-devel-3.9.25-2.el9.x86_64.rpm 15 MB/s | 244 kB 00:00 2026-02-18T03:13:50.970 INFO:teuthology.orchestra.run.trial119.stdout:(39/95): python3-jmespath-1.0.1-1.el9.noarch.rp 6.1 MB/s | 48 kB 00:00 2026-02-18T03:13:50.970 INFO:teuthology.orchestra.run.trial119.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 26 MB/s | 249 kB 00:00 2026-02-18T03:13:50.978 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:50.978 INFO:teuthology.orchestra.run.trial119.stdout:(41/95): python3-libstoragemgmt-1.10.1-1.el9.x8 22 MB/s | 177 kB 00:00 2026-02-18T03:13:50.986 INFO:teuthology.orchestra.run.trial119.stdout:(42/95): python3-markupsafe-1.1.1-12.el9.x86_64 4.4 MB/s | 35 kB 00:00 2026-02-18T03:13:50.988 INFO:teuthology.orchestra.run.trial119.stdout:(43/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 70 MB/s | 1.2 MB 00:00 2026-02-18T03:13:50.999 INFO:teuthology.orchestra.run.trial119.stdout:(44/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 41 MB/s | 442 kB 00:00 2026-02-18T03:13:51.007 INFO:teuthology.orchestra.run.trial119.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 9.7 MB/s | 77 kB 00:00 2026-02-18T03:13:51.016 INFO:teuthology.orchestra.run.trial119.stdout:(46/95): python3-protobuf-3.14.0-17.el9.noarch. 28 MB/s | 267 kB 00:00 2026-02-18T03:13:51.025 INFO:teuthology.orchestra.run.trial119.stdout:(47/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 18 MB/s | 159 kB 00:00 2026-02-18T03:13:51.032 INFO:teuthology.orchestra.run.trial119.stdout:(48/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 132 MB/s | 6.1 MB 00:00 2026-02-18T03:13:51.034 INFO:teuthology.orchestra.run.trial119.stdout:(49/95): python3-pyasn1-modules-0.4.8-6.el9.noa 31 MB/s | 279 kB 00:00 2026-02-18T03:13:51.041 INFO:teuthology.orchestra.run.trial119.stdout:(50/95): python3-requests-oauthlib-1.3.0-12.el9 6.6 MB/s | 54 kB 00:00 2026-02-18T03:13:51.043 INFO:teuthology.orchestra.run.trial097.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:51.048 INFO:teuthology.orchestra.run.trial114.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 1.8 MB/s | 154 kB 00:00 2026-02-18T03:13:51.048 INFO:teuthology.orchestra.run.trial119.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 5.3 MB/s | 42 kB 00:00 2026-02-18T03:13:51.049 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:51.049 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-18T03:13:51.049 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:13:51.054 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:13:51.054 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:13:51.057 INFO:teuthology.orchestra.run.trial119.stdout:(52/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 20 MB/s | 189 kB 00:00 2026-02-18T03:13:51.061 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:51.061 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:51.061 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:51.066 INFO:teuthology.orchestra.run.trial119.stdout:(53/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 11 MB/s | 90 kB 00:00 2026-02-18T03:13:51.079 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:51.084 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librbd1 2026-02-18T03:13:51.087 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:13:51.088 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:13:51.102 INFO:teuthology.orchestra.run.trial119.stdout:(54/95): lua-devel-5.4.4-4.el9.x86_64.rpm 620 kB/s | 22 kB 00:00 2026-02-18T03:13:51.142 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:13:51.143 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:51.143 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:51.161 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:51.161 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:51.162 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:51.163 INFO:teuthology.orchestra.run.trial119.stdout:(55/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 149 MB/s | 19 MB 00:00 2026-02-18T03:13:51.165 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:51.165 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:51.165 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:13:51.165 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:51.166 INFO:teuthology.orchestra.run.trial119.stdout:(56/95): protobuf-compiler-3.14.0-17.el9.x86_64 13 MB/s | 862 kB 00:00 2026-02-18T03:13:51.178 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:51.182 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:13:51.236 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:51.236 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:51.236 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:51.236 INFO:teuthology.orchestra.run.trial194.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:51.236 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:51.236 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:51.264 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-volume 2026-02-18T03:13:51.267 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:13:51.276 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:13:51.280 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:13:51.286 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:13:51.288 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:13:51.316 INFO:teuthology.orchestra.run.trial031.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:13:51.360 INFO:teuthology.orchestra.run.trial031.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:13:51.367 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:13:51.370 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:13:51.376 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:13:51.380 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:13:51.387 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:13:51.390 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:13:51.394 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:51.418 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:13:51.428 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:13:51.434 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:13:51.441 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:13:51.458 INFO:teuthology.orchestra.run.trial097.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:51.468 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:51.468 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:51.468 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:13:51.468 INFO:teuthology.orchestra.run.trial114.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:51.468 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:51.468 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:51.475 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:13:51.476 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:51.476 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:51.476 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:51.496 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr 2026-02-18T03:13:51.498 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rados 2026-02-18T03:13:51.499 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:51.536 INFO:teuthology.orchestra.run.trial119.stdout:(57/95): ceph-mgr-dashboard-20.2.0-670.gadc1923 5.9 MB/s | 11 MB 00:01 2026-02-18T03:13:51.561 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:51.564 INFO:teuthology.orchestra.run.trial119.stdout:(58/95): grpc-data-1.46.7-10.el9.noarch.rpm 49 kB/s | 19 kB 00:00 2026-02-18T03:13:51.578 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:51.579 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:51.579 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:51.581 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:51.600 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-fuse 2026-02-18T03:13:51.645 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:51.663 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:51.664 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:51.664 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:51.685 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librados-devel 2026-02-18T03:13:51.700 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:13:51.724 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:13:51.728 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:13:51.788 INFO:teuthology.orchestra.run.trial031.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:13:51.790 INFO:teuthology.orchestra.run.trial031.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:13:51.803 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:51.811 INFO:teuthology.orchestra.run.trial031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:13:51.812 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:51.867 INFO:teuthology.orchestra.run.trial097.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:51.877 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:51.885 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:51.886 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:51.886 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:51.895 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:51.895 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:51.895 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:51.908 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rgw 2026-02-18T03:13:51.909 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:51.917 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:13:51.991 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:51.992 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-18T03:13:51.993 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:51.993 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 942 k 2026-02-18T03:13:51.993 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 2.7 M 2026-02-18T03:13:51.993 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:51.999 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:52.080 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:52.081 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:52.081 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-18T03:13:52.081 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:52.081 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:52.081 INFO:teuthology.orchestra.run.trial194.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:13:52.081 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:52.081 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:52.082 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:52.082 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-18T03:13:52.082 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:52.082 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 126 k 2026-02-18T03:13:52.082 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 449 k 2026-02-18T03:13:52.082 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:52.088 INFO:teuthology.orchestra.run.trial119.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 274 kB/s | 151 kB 00:00 2026-02-18T03:13:52.111 INFO:teuthology.orchestra.run.trial078.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 7.7 MB/s | 942 kB 00:00 2026-02-18T03:13:52.112 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:52.112 INFO:teuthology.orchestra.run.trial078.stdout:Total 7.7 MB/s | 942 kB 00:00 2026-02-18T03:13:52.112 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:52.116 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:52.116 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:52.136 INFO:teuthology.orchestra.run.trial031.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:13:52.149 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:52.149 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:52.166 INFO:teuthology.orchestra.run.trial194.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-18T03:13:52.166 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:52.166 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-18T03:13:52.167 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:52.167 INFO:teuthology.orchestra.run.trial119.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 371 kB/s | 29 kB 00:00 2026-02-18T03:13:52.169 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:52.169 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:52.200 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:52.200 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:52.206 INFO:teuthology.orchestra.run.trial119.stdout:(61/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 529 kB/s | 551 kB 00:01 2026-02-18T03:13:52.209 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:13:52.219 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:52.224 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:36 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:52.240 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:52.246 INFO:teuthology.orchestra.run.trial119.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 762 kB/s | 60 kB 00:00 2026-02-18T03:13:52.254 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:52.256 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:52.267 INFO:teuthology.orchestra.run.trial119.stdout:(63/95): python3-asyncssh-2.13.2-5.el9.noarch.r 780 kB/s | 548 kB 00:00 2026-02-18T03:13:52.271 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:52.283 INFO:teuthology.orchestra.run.trial097.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:52.287 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:52.294 INFO:teuthology.orchestra.run.trial119.stdout:(64/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 491 kB/s | 43 kB 00:00 2026-02-18T03:13:52.301 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:52.302 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:52.302 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:52.305 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:52.306 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:52.306 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:52.325 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-cephfs 2026-02-18T03:13:52.327 INFO:teuthology.orchestra.run.trial119.stdout:(65/95): python3-cachetools-4.2.4-1.el9.noarch. 401 kB/s | 32 kB 00:00 2026-02-18T03:13:52.329 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:13:52.345 INFO:teuthology.orchestra.run.trial119.stdout:(66/95): python3-certifi-2023.05.07-4.el9.noarc 180 kB/s | 14 kB 00:00 2026-02-18T03:13:52.350 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:52.407 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:52.408 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:52.408 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:52.408 INFO:teuthology.orchestra.run.trial194.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:52.408 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:52.408 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:52.435 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install libcephfs2 2026-02-18T03:13:52.468 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:52.524 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:52.525 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:52.525 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:52.525 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:52.525 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:52.525 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:52.532 INFO:teuthology.orchestra.run.trial119.stdout:(67/95): python3-cheroot-10.0.1-4.el9.noarch.rp 729 kB/s | 173 kB 00:00 2026-02-18T03:13:52.552 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-volume 2026-02-18T03:13:52.634 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:52.643 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:36 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:52.658 INFO:teuthology.orchestra.run.trial119.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 813 kB/s | 254 kB 00:00 2026-02-18T03:13:52.697 INFO:teuthology.orchestra.run.trial097.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:52.707 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:52.715 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:52.715 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:52.715 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:52.725 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:52.726 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:52.726 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:52.738 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rbd 2026-02-18T03:13:52.742 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:52.747 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:13:52.806 INFO:teuthology.orchestra.run.trial194.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:52.810 INFO:teuthology.orchestra.run.trial119.stdout:(69/95): python3-cherrypy-18.6.1-2.el9.noarch.r 742 kB/s | 358 kB 00:00 2026-02-18T03:13:52.823 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:52.824 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:52.824 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:52.845 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install libcephfs-devel 2026-02-18T03:13:52.864 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:52.883 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:13:52.893 INFO:teuthology.orchestra.run.trial119.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 616 kB/s | 144 kB 00:00 2026-02-18T03:13:52.900 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:13:52.910 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:13:52.917 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:13:52.929 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:52.930 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:13:52.946 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:13:52.946 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:52.947 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:52.947 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:52.968 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librados-devel 2026-02-18T03:13:52.972 INFO:teuthology.orchestra.run.trial119.stdout:(71/95): python3-isodate-0.6.1-3.el9.noarch.rpm 709 kB/s | 56 kB 00:00 2026-02-18T03:13:52.977 INFO:teuthology.orchestra.run.trial119.stdout:(72/95): python3-influxdb-5.3.1-1.el9.noarch.rp 831 kB/s | 139 kB 00:00 2026-02-18T03:13:53.021 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:13:53.029 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:13:53.046 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:53.051 INFO:teuthology.orchestra.run.trial119.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 136 kB/s | 11 kB 00:00 2026-02-18T03:13:53.053 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:13:53.054 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:53.056 INFO:teuthology.orchestra.run.trial119.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 224 kB/s | 18 kB 00:00 2026-02-18T03:13:53.082 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:13:53.110 INFO:teuthology.orchestra.run.trial097.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:53.119 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:53.128 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:53.129 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-18T03:13:53.129 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:53.129 INFO:teuthology.orchestra.run.trial119.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 294 kB/s | 23 kB 00:00 2026-02-18T03:13:53.133 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:13:53.137 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:53.138 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:53.138 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:53.139 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:13:53.142 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:13:53.144 INFO:teuthology.orchestra.run.trial119.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 225 kB/s | 20 kB 00:00 2026-02-18T03:13:53.144 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:13:53.150 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-fuse 2026-02-18T03:13:53.155 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:53.159 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:13:53.162 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:53.162 INFO:teuthology.orchestra.run.trial031.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:13:53.162 INFO:teuthology.orchestra.run.trial031.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:13:53.162 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:53.172 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:53.199 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:53.199 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:13:53.199 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:53.208 INFO:teuthology.orchestra.run.trial119.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 247 kB/s | 19 kB 00:00 2026-02-18T03:13:53.234 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:13:53.238 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:53.238 INFO:teuthology.orchestra.run.trial119.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 281 kB/s | 26 kB 00:00 2026-02-18T03:13:53.239 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:53.239 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-18T03:13:53.239 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:53.239 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:53.239 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:13:53.239 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:53.239 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:53.240 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:53.240 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-18T03:13:53.240 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:53.240 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 34 k 2026-02-18T03:13:53.240 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 155 k 2026-02-18T03:13:53.240 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:53.282 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:53.298 INFO:teuthology.orchestra.run.trial031.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:13:53.300 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:53.314 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:53.314 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:53.314 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:13:53.314 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:53.363 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:53.364 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:53.364 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-18T03:13:53.364 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:53.364 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 126 k 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 449 k 2026-02-18T03:13:53.365 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:53.395 INFO:teuthology.orchestra.run.trial119.stdout:(79/95): python3-more-itertools-8.12.0-2.el9.no 502 kB/s | 79 kB 00:00 2026-02-18T03:13:53.458 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:53.468 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:53.492 INFO:teuthology.orchestra.run.trial194.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 136 kB/s | 34 kB 00:00 2026-02-18T03:13:53.492 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:53.492 INFO:teuthology.orchestra.run.trial194.stdout:Total 136 kB/s | 34 kB 00:00 2026-02-18T03:13:53.492 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:53.494 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:53.494 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:53.497 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:53.497 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:53.517 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:53.531 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:53.533 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:53.539 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:53.540 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:53.540 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:53.540 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:53.540 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:53.540 INFO:teuthology.orchestra.run.trial097.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:13:53.540 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:53.541 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:53.541 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:53.541 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-18T03:13:53.541 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:53.541 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 91 k 2026-02-18T03:13:53.541 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 238 k 2026-02-18T03:13:53.541 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:53.549 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:53.549 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:53.550 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:53.557 INFO:teuthology.orchestra.run.trial119.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 532 kB/s | 86 kB 00:00 2026-02-18T03:13:53.571 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-fuse 2026-02-18T03:13:53.589 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:53.636 INFO:teuthology.orchestra.run.trial119.stdout:(81/95): python3-natsort-7.1.1-5.el9.noarch.rpm 732 kB/s | 58 kB 00:00 2026-02-18T03:13:53.647 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:53.647 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:53.648 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:53.648 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:53.648 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:53.648 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:53.678 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librados2 2026-02-18T03:13:53.712 INFO:teuthology.orchestra.run.trial078.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 362 kB/s | 126 kB 00:00 2026-02-18T03:13:53.713 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:53.713 INFO:teuthology.orchestra.run.trial078.stdout:Total 361 kB/s | 126 kB 00:00 2026-02-18T03:13:53.713 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:53.716 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:53.716 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:53.725 INFO:teuthology.orchestra.run.trial119.stdout:(82/95): python3-portend-3.1.0-2.el9.noarch.rpm 184 kB/s | 16 kB 00:00 2026-02-18T03:13:53.747 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:53.747 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:53.801 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:53.817 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:53.834 INFO:teuthology.orchestra.run.trial097.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 310 kB/s | 91 kB 00:00 2026-02-18T03:13:53.835 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:53.835 INFO:teuthology.orchestra.run.trial097.stdout:Total 309 kB/s | 91 kB 00:00 2026-02-18T03:13:53.835 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:53.839 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:53.839 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:53.871 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:53.871 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:53.873 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:53.892 INFO:teuthology.orchestra.run.trial119.stdout:(83/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 540 kB/s | 90 kB 00:00 2026-02-18T03:13:53.898 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:53.912 INFO:teuthology.orchestra.run.trial119.stdout:(84/95): python3-kubernetes-26.1.0-3.el9.noarch 1.5 MB/s | 1.0 MB 00:00 2026-02-18T03:13:53.922 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:53.939 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:53.956 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:53.957 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:53.957 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:53.957 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:53.957 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:53.957 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:53.957 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:53.958 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-18T03:13:53.959 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:53.959 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 942 k 2026-02-18T03:13:53.959 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 2.7 M 2026-02-18T03:13:53.959 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:13:53.971 INFO:teuthology.orchestra.run.trial119.stdout:(85/95): python3-repoze-lru-0.7-16.el9.noarch.r 387 kB/s | 31 kB 00:00 2026-02-18T03:13:53.985 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install libcephfs2 2026-02-18T03:13:53.986 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:53.989 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:53.999 INFO:teuthology.orchestra.run.trial119.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 2.1 MB/s | 188 kB 00:00 2026-02-18T03:13:54.014 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:54.014 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:54.015 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:54.015 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:13:54.015 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:54.015 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:54.015 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:54.050 INFO:teuthology.orchestra.run.trial194.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:54.050 INFO:teuthology.orchestra.run.trial119.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 747 kB/s | 59 kB 00:00 2026-02-18T03:13:54.067 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:54.068 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:54.068 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:54.071 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:54.071 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:54.071 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:54.071 INFO:teuthology.orchestra.run.trial097.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:54.071 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:54.071 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:54.074 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:54.076 INFO:teuthology.orchestra.run.trial031.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:54.078 INFO:teuthology.orchestra.run.trial119.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 1.5 MB/s | 125 kB 00:00 2026-02-18T03:13:54.083 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:13:54.090 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librbd1 2026-02-18T03:13:54.100 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-mirror 2026-02-18T03:13:54.106 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:13:54.107 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:54.135 INFO:teuthology.orchestra.run.trial119.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 423 kB/s | 36 kB 00:00 2026-02-18T03:13:54.158 INFO:teuthology.orchestra.run.trial119.stdout:(90/95): python3-typing-extensions-4.15.0-1.el9 1.1 MB/s | 86 kB 00:00 2026-02-18T03:13:54.237 INFO:teuthology.orchestra.run.trial119.stdout:(91/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 614 kB/s | 48 kB 00:00 2026-02-18T03:13:54.255 INFO:teuthology.orchestra.run.trial114.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 3.1 MB/s | 942 kB 00:00 2026-02-18T03:13:54.255 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:54.256 INFO:teuthology.orchestra.run.trial114.stdout:Total 3.1 MB/s | 942 kB 00:00 2026-02-18T03:13:54.256 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:13:54.260 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:13:54.261 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:13:54.291 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:54.294 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:13:54.294 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:13:54.303 INFO:teuthology.orchestra.run.trial119.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 535 kB/s | 90 kB 00:00 2026-02-18T03:13:54.324 INFO:teuthology.orchestra.run.trial119.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 255 kB/s | 22 kB 00:00 2026-02-18T03:13:54.355 INFO:teuthology.orchestra.run.trial078.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:54.373 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:54.374 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:54.374 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:54.383 INFO:teuthology.orchestra.run.trial119.stdout:(94/95): python3-zc-lockfile-2.0-10.el9.noarch. 249 kB/s | 20 kB 00:00 2026-02-18T03:13:54.384 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:13:54.395 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install libcephfs-devel 2026-02-18T03:13:54.400 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:54.401 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:54.410 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:54.465 INFO:teuthology.orchestra.run.trial194.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:54.482 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:54.483 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:54.483 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:54.492 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:54.493 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:54.493 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-18T03:13:54.493 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:54.493 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:54.493 INFO:teuthology.orchestra.run.trial097.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:13:54.493 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:54.494 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:54.494 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:54.494 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-18T03:13:54.494 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:54.494 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 2.9 M 2026-02-18T03:13:54.494 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 11 M 2026-02-18T03:13:54.494 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:54.505 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rados 2026-02-18T03:13:54.639 INFO:teuthology.orchestra.run.trial097.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-18T03:13:54.639 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:54.639 INFO:teuthology.orchestra.run.trial097.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-18T03:13:54.639 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:54.640 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:54.644 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:54.644 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:54.683 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:54.683 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:54.695 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:54.695 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:54.695 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:13:54.695 INFO:teuthology.orchestra.run.trial114.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:54.695 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:54.695 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:54.705 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:54.723 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-volume 2026-02-18T03:13:54.787 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:54.788 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:54.788 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-18T03:13:54.788 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:54.788 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:54.788 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:13:54.789 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:54.789 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:54.789 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:54.789 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-18T03:13:54.789 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:54.789 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 34 k 2026-02-18T03:13:54.789 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 155 k 2026-02-18T03:13:54.789 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:54.811 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:54.851 INFO:teuthology.orchestra.run.trial078.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 550 kB/s | 34 kB 00:00 2026-02-18T03:13:54.851 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:54.852 INFO:teuthology.orchestra.run.trial078.stdout:Total 543 kB/s | 34 kB 00:00 2026-02-18T03:13:54.852 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:54.853 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:54.853 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:54.855 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:54.855 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:54.863 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:54.864 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:54.874 INFO:teuthology.orchestra.run.trial194.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:54.876 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:54.888 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:54.888 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:54.888 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:13:54.888 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:13:54.888 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:13:54.889 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:54.892 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:54.893 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:54.893 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:54.893 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:54.899 INFO:teuthology.orchestra.run.trial119.stdout:(95/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 881 kB/s | 2.0 MB 00:02 2026-02-18T03:13:54.903 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:54.904 INFO:teuthology.orchestra.run.trial119.stdout:Total 15 MB/s | 101 MB 00:06 2026-02-18T03:13:54.914 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rgw 2026-02-18T03:13:54.946 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:55.002 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:55.002 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:55.002 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:55.002 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:55.002 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:55.002 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:55.028 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librados2 2026-02-18T03:13:55.030 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:55.094 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:55.112 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:55.113 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:55.113 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:55.135 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados-devel 2026-02-18T03:13:55.197 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:55.197 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:55.197 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:55.197 INFO:teuthology.orchestra.run.trial097.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:55.197 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:55.198 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:55.225 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-nbd 2026-02-18T03:13:55.226 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:55.252 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:55.257 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:55.288 INFO:teuthology.orchestra.run.trial194.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:55.306 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:55.307 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:55.307 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:55.329 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-cephfs 2026-02-18T03:13:55.333 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:13:55.338 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:55.370 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:13:55.370 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:13:55.404 INFO:teuthology.orchestra.run.trial078.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:55.421 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:55.422 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:55.422 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:55.440 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:55.443 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librbd1 2026-02-18T03:13:55.523 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:55.523 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-18T03:13:55.524 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:55.525 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 126 k 2026-02-18T03:13:55.525 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 449 k 2026-02-18T03:13:55.525 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:13:55.535 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:55.616 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-18T03:13:55.617 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:55.618 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 180 k 2026-02-18T03:13:55.618 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 498 k 2026-02-18T03:13:55.618 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:55.635 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:55.699 INFO:teuthology.orchestra.run.trial194.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:55.711 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:13:55.712 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:55.716 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:55.717 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:55.717 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:55.725 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:13:55.725 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:55.738 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rbd 2026-02-18T03:13:55.751 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:55.782 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:13:55.802 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:13:55.803 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:13:55.816 INFO:teuthology.orchestra.run.trial078.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:55.825 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:13:55.826 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:55.834 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:55.834 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:55.834 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:55.847 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:13:55.847 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:55.847 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:13:55.847 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:55.847 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:13:55.848 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:55.855 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rados 2026-02-18T03:13:55.859 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:55.871 INFO:teuthology.orchestra.run.trial114.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 362 kB/s | 126 kB 00:00 2026-02-18T03:13:55.872 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:55.872 INFO:teuthology.orchestra.run.trial114.stdout:Total 361 kB/s | 126 kB 00:00 2026-02-18T03:13:55.872 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:13:55.875 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:13:55.875 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:13:55.906 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:13:55.906 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:13:55.961 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:13:55.977 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.029 INFO:teuthology.orchestra.run.trial097.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 436 kB/s | 180 kB 00:00 2026-02-18T03:13:56.030 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:56.030 INFO:teuthology.orchestra.run.trial097.stdout:Total 435 kB/s | 180 kB 00:00 2026-02-18T03:13:56.030 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:56.035 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:56.035 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:56.045 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:56.057 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.066 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:56.067 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:56.079 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:13:56.081 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:56.102 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:13:56.102 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:56.102 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:13:56.102 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:56.103 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:13:56.103 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:56.109 INFO:teuthology.orchestra.run.trial194.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:56.114 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.114 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:56.114 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:13:56.115 INFO:teuthology.orchestra.run.trial114.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:56.115 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:56.115 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:56.123 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:56.126 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:56.127 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-18T03:13:56.127 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:56.139 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.143 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs2 2026-02-18T03:13:56.149 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-fuse 2026-02-18T03:13:56.158 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:56.200 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:56.221 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:13:56.221 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:56.222 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:13:56.222 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:56.222 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:13:56.222 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:56.222 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:56.226 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.239 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:56.240 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:56.240 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:56.240 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:56.259 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:13:56.261 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rgw 2026-02-18T03:13:56.262 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:13:56.265 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:13:56.283 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.283 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:56.284 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-18T03:13:56.284 INFO:teuthology.orchestra.run.trial097.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:56.284 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:56.284 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:56.287 INFO:teuthology.orchestra.run.trial119.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:13:56.312 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install nvme-cli 2026-02-18T03:13:56.320 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:13:56.329 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:13:56.334 INFO:teuthology.orchestra.run.trial119.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:13:56.337 INFO:teuthology.orchestra.run.trial119.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:13:56.341 INFO:teuthology.orchestra.run.trial119.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:13:56.365 INFO:teuthology.orchestra.run.trial119.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:13:56.378 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:13:56.381 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:13:56.387 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:13:56.389 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:13:56.400 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:13:56.406 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:13:56.430 INFO:teuthology.orchestra.run.trial119.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:13:56.433 INFO:teuthology.orchestra.run.trial119.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:13:56.440 INFO:teuthology.orchestra.run.trial119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:13:56.457 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:56.463 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:56.491 INFO:teuthology.orchestra.run.trial119.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:13:56.504 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:13:56.508 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:13:56.512 INFO:teuthology.orchestra.run.trial119.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:13:56.518 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:13:56.521 INFO:teuthology.orchestra.run.trial114.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:56.522 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:13:56.526 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:13:56.540 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:56.540 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:13:56.541 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:56.541 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:56.545 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:13:56.545 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:56.546 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:56.546 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:56.546 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:56.546 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:56.546 INFO:teuthology.orchestra.run.trial194.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:13:56.546 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:56.546 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:56.546 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:56.547 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-18T03:13:56.547 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:56.547 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 91 k 2026-02-18T03:13:56.547 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 238 k 2026-02-18T03:13:56.547 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:56.550 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:13:56.562 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs-devel 2026-02-18T03:13:56.562 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:13:56.565 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:56.570 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:13:56.576 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:13:56.596 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:13:56.607 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:13:56.623 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:13:56.627 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:13:08 AM UTC. 2026-02-18T03:13:56.628 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:13:56.630 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:56.635 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:13:56.648 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:56.648 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:56.649 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:56.670 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-cephfs 2026-02-18T03:13:56.675 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:13:56.691 INFO:teuthology.orchestra.run.trial097.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:13:56.709 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-18T03:13:56.710 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:56.710 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:56.710 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:56.710 INFO:teuthology.orchestra.run.trial097.stdout:Upgrading: 2026-02-18T03:13:56.710 INFO:teuthology.orchestra.run.trial097.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:13:56.710 INFO:teuthology.orchestra.run.trial097.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:13:56.710 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:56.711 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-18T03:13:56.711 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-18T03:13:56.711 INFO:teuthology.orchestra.run.trial097.stdout:Upgrade 2 Packages 2026-02-18T03:13:56.711 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:56.711 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 1.3 M 2026-02-18T03:13:56.711 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-18T03:13:56.745 INFO:teuthology.orchestra.run.trial194.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 458 kB/s | 91 kB 00:00 2026-02-18T03:13:56.746 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:56.747 INFO:teuthology.orchestra.run.trial194.stdout:Total 453 kB/s | 91 kB 00:00 2026-02-18T03:13:56.747 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:56.751 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:56.752 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:56.783 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:56.783 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:56.792 INFO:teuthology.orchestra.run.trial097.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 6.0 MB/s | 116 kB 00:00 2026-02-18T03:13:56.803 INFO:teuthology.orchestra.run.trial097.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 40 MB/s | 1.2 MB 00:00 2026-02-18T03:13:56.803 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:56.803 INFO:teuthology.orchestra.run.trial097.stdout:Total 14 MB/s | 1.3 MB 00:00 2026-02-18T03:13:56.823 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-18T03:13:56.829 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-18T03:13:56.829 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-18T03:13:56.835 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:56.852 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.871 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-18T03:13:56.872 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-18T03:13:56.873 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:56.918 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:13:56.918 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:13:56.919 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:13:56.920 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:13:56.921 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:13:56.922 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:13:56.923 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:13:56.924 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:13:56.925 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:13:56.926 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:13:56.926 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:13:56.926 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:13:56.926 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:13:56.926 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:13:56.933 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.934 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-18T03:13:56.958 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:56.958 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:56.958 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-18T03:13:56.958 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 34 k 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 155 k 2026-02-18T03:13:56.959 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:13:56.981 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:13:56.981 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:56.981 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:13:56.981 INFO:teuthology.orchestra.run.trial031.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:13:56.981 INFO:teuthology.orchestra.run.trial031.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.982 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:13:56.983 INFO:teuthology.orchestra.run.trial031.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:13:56.984 INFO:teuthology.orchestra.run.trial031.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:13:56.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:13:56.986 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:13:56.987 INFO:teuthology.orchestra.run.trial031.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:13:56.988 INFO:teuthology.orchestra.run.trial031.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:13:56.989 INFO:teuthology.orchestra.run.trial031.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:13:56.990 INFO:teuthology.orchestra.run.trial031.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:13:56.991 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:56.991 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:13:56.991 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:56.992 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:56.992 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:56.992 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:56.993 INFO:teuthology.orchestra.run.trial194.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:56.993 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:56.993 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:57.002 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:13:57.012 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:13:57.016 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:13:57.020 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-mirror 2026-02-18T03:13:57.023 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:13:57.024 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:13:57.038 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-base 2026-02-18T03:13:57.046 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:57.052 INFO:teuthology.orchestra.run.trial119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:13:57.056 INFO:teuthology.orchestra.run.trial097.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:13:57.058 INFO:teuthology.orchestra.run.trial097.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:13:57.064 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:57.065 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:57.065 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:57.086 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rbd 2026-02-18T03:13:57.096 INFO:teuthology.orchestra.run.trial119.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:13:57.103 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:13:57.106 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:13:57.112 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:13:57.116 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:13:57.123 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:13:57.126 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:13:57.154 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:13:57.164 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:13:57.170 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:13:57.177 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:13:57.206 INFO:teuthology.orchestra.run.trial114.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 138 kB/s | 34 kB 00:00 2026-02-18T03:13:57.208 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:57.208 INFO:teuthology.orchestra.run.trial114.stdout:Total 137 kB/s | 34 kB 00:00 2026-02-18T03:13:57.208 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:13:57.211 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:13:57.211 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:13:57.212 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:13:57.213 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:13:57.213 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:13:57.234 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:13:57.239 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:13:57.243 INFO:teuthology.orchestra.run.trial097.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:13:57.250 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:57.266 INFO:teuthology.orchestra.run.trial097.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:13:57.305 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:57.337 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:57.354 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:13:57.362 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:57.362 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:57.362 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:13:57.362 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:57.362 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:13:57.362 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:57.390 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados2 2026-02-18T03:13:57.393 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:57.417 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:57.418 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:57.419 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:57.419 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-18T03:13:57.419 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:57.419 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:57.419 INFO:teuthology.orchestra.run.trial194.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:13:57.420 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:57.420 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:57.420 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:57.420 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-18T03:13:57.420 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:57.420 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 2.9 M 2026-02-18T03:13:57.420 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 11 M 2026-02-18T03:13:57.420 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:57.435 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:13:57.436 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:13:57.436 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:13:57.437 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:13:57.455 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:57.458 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install cephadm 2026-02-18T03:13:57.461 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:13:57.465 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:13:57.473 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:57.474 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-18T03:13:57.474 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:57.495 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-fuse 2026-02-18T03:13:57.520 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:13:57.521 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:13:57.521 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:13:57.521 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:13:57.523 INFO:teuthology.orchestra.run.trial119.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:13:57.525 INFO:teuthology.orchestra.run.trial119.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:13:57.546 INFO:teuthology.orchestra.run.trial119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:13:57.578 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:13:57.578 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:57.579 INFO:teuthology.orchestra.run.trial097.stdout:Upgraded: 2026-02-18T03:13:57.579 INFO:teuthology.orchestra.run.trial097.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:13:57.579 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:13:57.579 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-18T03:13:57.613 DEBUG:teuthology.parallel:result is None 2026-02-18T03:13:57.700 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:57.764 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:13:57.764 INFO:teuthology.orchestra.run.trial114.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:57.781 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:57.782 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:57.782 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:57.804 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librbd1 2026-02-18T03:13:57.805 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:57.829 INFO:teuthology.orchestra.run.trial031.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:57.846 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:13:57.847 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:13:57.847 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:13:57.869 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:13:57.875 INFO:teuthology.orchestra.run.trial119.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:13:57.887 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:57.888 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:57.888 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:57.888 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:57.888 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:57.888 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:13:57.888 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:57.888 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:57.888 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:57.889 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-18T03:13:57.889 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:57.889 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 91 k 2026-02-18T03:13:57.889 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 238 k 2026-02-18T03:13:57.889 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:57.949 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:13:58.110 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:58.174 INFO:teuthology.orchestra.run.trial114.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:58.176 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:13:58.192 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:58.193 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:58.193 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:58.215 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rados 2026-02-18T03:13:58.258 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:13:58.259 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:58.259 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-18T03:13:58.259 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:58.259 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 154 k 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 447 k 2026-02-18T03:13:58.260 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:13:58.277 INFO:teuthology.orchestra.run.trial078.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 234 kB/s | 91 kB 00:00 2026-02-18T03:13:58.278 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:58.278 INFO:teuthology.orchestra.run.trial078.stdout:Total 233 kB/s | 91 kB 00:00 2026-02-18T03:13:58.278 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:58.283 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:58.283 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:58.313 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:58.314 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:58.365 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:58.381 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:58.453 INFO:teuthology.orchestra.run.trial194.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 2.8 MB/s | 2.9 MB 00:01 2026-02-18T03:13:58.454 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:58.454 INFO:teuthology.orchestra.run.trial194.stdout:Total 2.8 MB/s | 2.9 MB 00:01 2026-02-18T03:13:58.454 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:58.459 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:58.460 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:58.463 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:58.500 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:58.501 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:58.519 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:58.520 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:58.520 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:58.520 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:58.520 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:58.520 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:58.527 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:58.548 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-mirror 2026-02-18T03:13:58.592 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:58.610 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:58.610 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:58.610 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:58.626 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:13:58.632 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rgw 2026-02-18T03:13:58.643 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:13:58.653 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:13:58.660 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:13:58.673 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:13:58.683 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:58.684 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:58.689 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:13:58.708 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:58.708 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:58.708 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:13:58.708 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:13:58.708 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:13:58.708 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:58.717 INFO:teuthology.orchestra.run.trial031.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 336 kB/s | 154 kB 00:00 2026-02-18T03:13:58.718 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:58.718 INFO:teuthology.orchestra.run.trial031.stdout:Total 335 kB/s | 154 kB 00:00 2026-02-18T03:13:58.718 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:13:58.724 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:13:58.724 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:13:58.758 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:13:58.758 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:13:58.765 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:13:58.773 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:13:58.797 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:13:58.814 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:13:58.815 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:58.827 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:13:58.838 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:58.838 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:58.838 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:13:58.838 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:58.866 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:13:58.878 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:13:58.884 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:13:58.887 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:13:58.888 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:13:58.907 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:58.907 INFO:teuthology.orchestra.run.trial119.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:13:58.907 INFO:teuthology.orchestra.run.trial119.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:13:58.907 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:58.915 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:58.938 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:58.941 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:13:58.941 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:13:58.941 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:13:58.949 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:13:58.950 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-18T03:13:58.950 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:58.950 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 2.9 M 2026-02-18T03:13:58.950 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 11 M 2026-02-18T03:13:58.950 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:13:58.977 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:13:59.002 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:59.019 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:59.019 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:59.019 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:59.019 INFO:teuthology.orchestra.run.trial194.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:59.019 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:59.020 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:59.020 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:59.021 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:59.021 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:59.041 INFO:teuthology.orchestra.run.trial119.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:13:59.042 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-cephfs 2026-02-18T03:13:59.043 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:59.048 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-nbd 2026-02-18T03:13:59.057 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:13:59.057 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:59.057 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:13:59.057 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:59.096 INFO:teuthology.orchestra.run.trial078.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-18T03:13:59.096 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:59.096 INFO:teuthology.orchestra.run.trial078.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-18T03:13:59.097 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:13:59.102 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:13:59.102 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:13:59.116 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:13:59.116 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:59.116 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:13:59.117 INFO:teuthology.orchestra.run.trial031.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:59.117 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:13:59.117 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:13:59.141 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:13:59.141 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:13:59.145 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr 2026-02-18T03:13:59.322 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:13:59.324 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:59.347 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:59.347 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:59.347 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:13:59.348 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:13:59.348 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:13:59.348 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:59.354 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:59.358 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:13:59.418 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:59.436 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:59.437 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:59.437 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:59.440 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:13:59.441 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:59.441 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-18T03:13:59.441 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:59.441 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-18T03:13:59.441 INFO:teuthology.orchestra.run.trial194.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:13:59.442 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:59.442 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:13:59.442 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:13:59.442 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-18T03:13:59.442 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:59.442 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 180 k 2026-02-18T03:13:59.442 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 498 k 2026-02-18T03:13:59.442 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:13:59.452 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:13:59.460 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rbd 2026-02-18T03:13:59.517 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:59.526 INFO:teuthology.orchestra.run.trial194.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-18T03:13:59.527 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:13:59.527 INFO:teuthology.orchestra.run.trial194.stdout:Total 2.1 MB/s | 180 kB 00:00 2026-02-18T03:13:59.527 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:13:59.531 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:13:59.531 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:13:59.535 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:13:59.536 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:13:59.536 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:13:59.556 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:13:59.562 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:13:59.562 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:13:59.618 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:13:59.635 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:59.660 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:59.660 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:59.660 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:13:59.660 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:59.660 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:13:59.661 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:13:59.687 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-nbd 2026-02-18T03:13:59.715 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:59.729 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:59.756 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:13:59.756 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:13:59.756 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:13:59.756 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:59.756 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:13:59.756 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:13:59.768 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:13:59.772 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:13:59.773 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:59.773 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-18T03:13:59.773 INFO:teuthology.orchestra.run.trial194.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:13:59.773 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:13:59.773 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:13:59.801 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install nvme-cli 2026-02-18T03:13:59.815 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:59.817 INFO:teuthology.orchestra.run.trial119.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:13:59.824 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:13:59.832 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:13:59.847 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:13:59.849 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:13:59.849 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:13:59.850 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-18T03:13:59.850 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:13:59.864 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:13:59.871 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-fuse 2026-02-18T03:13:59.928 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:13:59.945 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:13:59.946 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:13:59.946 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:13:59.968 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:14:00.001 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:14:00.084 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:14:00.084 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:14:00.084 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:00.084 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:14:00.084 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-18T03:14:00.084 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:14:00.084 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:14:00.085 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:14:00.085 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:14:00.085 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-18T03:14:00.085 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:14:00.085 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 180 k 2026-02-18T03:14:00.085 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 498 k 2026-02-18T03:14:00.085 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:14:00.122 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Feb 2026 03:13:06 AM UTC. 2026-02-18T03:14:00.168 INFO:teuthology.orchestra.run.trial078.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-18T03:14:00.168 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:00.169 INFO:teuthology.orchestra.run.trial078.stdout:Total 2.1 MB/s | 180 kB 00:00 2026-02-18T03:14:00.169 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:14:00.173 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:14:00.173 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:14:00.178 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:14:00.185 INFO:teuthology.orchestra.run.trial194.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:14:00.204 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial194.stdout:Upgrading: 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial194.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial194.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:14:00.205 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:14:00.206 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-18T03:14:00.206 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-18T03:14:00.206 INFO:teuthology.orchestra.run.trial194.stdout:Upgrade 2 Packages 2026-02-18T03:14:00.206 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:14:00.206 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 1.3 M 2026-02-18T03:14:00.206 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-18T03:14:00.260 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:14:00.261 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:14:00.262 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:00.262 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:00.262 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:00.262 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:14:00.262 INFO:teuthology.orchestra.run.trial114.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:14:00.262 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:00.262 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:14:00.263 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:00.263 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-18T03:14:00.263 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:00.263 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 91 k 2026-02-18T03:14:00.263 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 238 k 2026-02-18T03:14:00.263 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:14:00.274 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:00.277 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:00.339 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:00.356 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:00.357 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:00.357 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:00.361 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:00.378 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:14:00.418 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:00.419 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:14:00.419 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-18T03:14:00.419 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:00.419 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:14:00.419 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:14:00.446 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install nvme-cli 2026-02-18T03:14:00.567 INFO:teuthology.orchestra.run.trial114.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 298 kB/s | 91 kB 00:00 2026-02-18T03:14:00.568 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:00.569 INFO:teuthology.orchestra.run.trial114.stdout:Total 297 kB/s | 91 kB 00:00 2026-02-18T03:14:00.569 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:14:00.574 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:14:00.574 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:14:00.604 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:14:00.605 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:14:00.656 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:14:00.672 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:00.679 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:00.744 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:00.753 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:00.761 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:00.762 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:00.762 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:00.767 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:14:00.783 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:14:00.810 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:00.811 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:00.811 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:14:00.811 INFO:teuthology.orchestra.run.trial114.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:00.811 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:00.811 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:14:00.830 INFO:teuthology.orchestra.run.trial078.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:14:00.836 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-mirror 2026-02-18T03:14:00.849 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-18T03:14:00.849 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:14:00.849 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout:Upgrading: 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout:Upgrade 2 Packages 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:14:00.850 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 1.3 M 2026-02-18T03:14:00.851 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-18T03:14:00.998 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:14:01.003 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:14:01.007 INFO:teuthology.orchestra.run.trial194.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 164 kB/s | 116 kB 00:00 2026-02-18T03:14:01.088 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:01.151 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:01.164 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:14:01.169 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:01.169 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:01.169 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:01.190 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-fuse 2026-02-18T03:14:01.245 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:14:01.246 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:01.247 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 2.9 M 2026-02-18T03:14:01.248 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 11 M 2026-02-18T03:14:01.248 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:14:01.393 INFO:teuthology.orchestra.run.trial114.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-18T03:14:01.393 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:01.393 INFO:teuthology.orchestra.run.trial114.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-18T03:14:01.393 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:14:01.398 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:14:01.398 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:14:01.437 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:14:01.437 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:14:01.454 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:14:01.456 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:14:01.468 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:14:01.469 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:14:01.496 INFO:teuthology.orchestra.run.trial078.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 207 kB/s | 116 kB 00:00 2026-02-18T03:14:01.496 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:01.526 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:14:01.571 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:14:01.572 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:14:01.577 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:01.578 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:01.578 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:01.578 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 942 k 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 2.7 M 2026-02-18T03:14:01.579 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:14:01.594 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:14:01.594 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:14:01.594 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:14:01.594 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:14:01.594 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:14:01.594 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:01.605 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:14:01.619 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:14:01.621 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:01.644 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:01.644 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:14:01.644 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:14:01.645 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:14:01.645 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:14:01.645 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:01.697 INFO:teuthology.orchestra.run.trial031.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 7.8 MB/s | 942 kB 00:00 2026-02-18T03:14:01.697 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:01.698 INFO:teuthology.orchestra.run.trial031.stdout:Total 7.7 MB/s | 942 kB 00:00 2026-02-18T03:14:01.698 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:14:01.702 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:14:01.702 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:14:01.736 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:14:01.736 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:14:01.827 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:14:01.828 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:14:01.829 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:14:01.846 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:01.850 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:14:01.850 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:14:01.850 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:14:01.850 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:14:01.850 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:14:01.850 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:01.937 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:01.938 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:01.938 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:14:01.938 INFO:teuthology.orchestra.run.trial114.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:01.938 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:01.938 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:14:01.946 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:14:01.965 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-nbd 2026-02-18T03:14:01.967 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:14:01.967 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:14:01.967 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:14:01.967 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:14:01.967 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:14:01.967 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:01.985 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:14:02.067 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:02.124 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:02.124 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:02.124 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:14:02.124 INFO:teuthology.orchestra.run.trial031.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:02.124 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:02.124 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:02.151 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-volume 2026-02-18T03:14:02.170 INFO:teuthology.orchestra.run.trial194.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 629 kB/s | 1.2 MB 00:01 2026-02-18T03:14:02.171 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:02.171 INFO:teuthology.orchestra.run.trial194.stdout:Total 658 kB/s | 1.3 MB 00:01 2026-02-18T03:14:02.192 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-18T03:14:02.199 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-18T03:14:02.200 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-18T03:14:02.242 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-18T03:14:02.242 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-18T03:14:02.278 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:14:02.305 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-18T03:14:02.360 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:14:02.361 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:02.361 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:02.361 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:02.361 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-18T03:14:02.361 INFO:teuthology.orchestra.run.trial114.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:14:02.361 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:02.361 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:14:02.362 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:02.362 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-18T03:14:02.362 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:02.362 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 180 k 2026-02-18T03:14:02.362 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 498 k 2026-02-18T03:14:02.362 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:14:02.425 INFO:teuthology.orchestra.run.trial194.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:02.428 INFO:teuthology.orchestra.run.trial194.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:02.445 INFO:teuthology.orchestra.run.trial114.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-18T03:14:02.446 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:02.446 INFO:teuthology.orchestra.run.trial114.stdout:Total 2.1 MB/s | 180 kB 00:00 2026-02-18T03:14:02.446 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:14:02.451 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:14:02.451 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:14:02.456 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:02.482 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:14:02.482 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:14:02.520 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:02.537 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:02.538 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:14:02.538 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:02.539 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:02.554 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:02.559 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librados-devel 2026-02-18T03:14:02.616 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:02.620 INFO:teuthology.orchestra.run.trial194.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:14:02.634 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:02.645 INFO:teuthology.orchestra.run.trial194.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:02.661 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:14:02.661 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:14:02.661 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:14:02.661 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:14:02.661 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:14:02.661 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:14:02.662 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:14:02.663 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:14:02.664 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:14:02.665 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:14:02.666 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:14:02.667 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:14:02.668 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:14:02.669 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:14:02.669 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:14:02.685 INFO:teuthology.orchestra.run.trial078.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 674 kB/s | 1.2 MB 00:01 2026-02-18T03:14:02.685 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:02.686 INFO:teuthology.orchestra.run.trial078.stdout:Total 705 kB/s | 1.3 MB 00:01 2026-02-18T03:14:02.691 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:02.691 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:02.691 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-18T03:14:02.691 INFO:teuthology.orchestra.run.trial114.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:02.692 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:02.692 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:14:02.706 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-18T03:14:02.713 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-18T03:14:02.713 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-18T03:14:02.719 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install nvme-cli 2026-02-18T03:14:02.724 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:14:02.724 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:02.724 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:14:02.724 INFO:teuthology.orchestra.run.trial119.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:14:02.724 INFO:teuthology.orchestra.run.trial119.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:02.724 INFO:teuthology.orchestra.run.trial119.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.724 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:02.724 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:14:02.725 INFO:teuthology.orchestra.run.trial119.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:14:02.726 INFO:teuthology.orchestra.run.trial119.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:14:02.727 INFO:teuthology.orchestra.run.trial119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:14:02.728 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:14:02.729 INFO:teuthology.orchestra.run.trial119.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:14:02.730 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:14:02.731 INFO:teuthology.orchestra.run.trial119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:14:02.732 INFO:teuthology.orchestra.run.trial119.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:14:02.732 INFO:teuthology.orchestra.run.trial119.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:14:02.732 INFO:teuthology.orchestra.run.trial119.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:14:02.732 INFO:teuthology.orchestra.run.trial119.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:14:02.732 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:02.732 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:02.756 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-18T03:14:02.756 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-18T03:14:02.781 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-base 2026-02-18T03:14:02.819 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-18T03:14:02.872 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:02.885 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:02.885 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:02.885 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:14:02.885 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:14:02.940 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:02.943 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:02.944 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:14:02.944 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:14:02.944 INFO:teuthology.orchestra.run.trial194.stdout:Upgraded: 2026-02-18T03:14:02.944 INFO:teuthology.orchestra.run.trial194.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:14:02.944 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:14:02.944 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-18T03:14:02.953 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:02.954 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:02.954 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-18T03:14:02.954 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:02.954 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:14:02.954 INFO:teuthology.orchestra.run.trial031.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:14:02.954 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:02.954 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:14:02.954 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:02.955 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-18T03:14:02.955 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:02.955 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 126 k 2026-02-18T03:14:02.955 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 449 k 2026-02-18T03:14:02.955 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:14:02.980 DEBUG:teuthology.parallel:result is None 2026-02-18T03:14:03.027 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:16 AM UTC. 2026-02-18T03:14:03.091 INFO:teuthology.orchestra.run.trial114.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:14:03.096 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:03.109 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-18T03:14:03.110 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:03.110 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:03.110 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:03.110 INFO:teuthology.orchestra.run.trial114.stdout:Upgrading: 2026-02-18T03:14:03.110 INFO:teuthology.orchestra.run.trial114.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:14:03.110 INFO:teuthology.orchestra.run.trial114.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:14:03.110 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:03.110 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-18T03:14:03.111 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-18T03:14:03.111 INFO:teuthology.orchestra.run.trial114.stdout:Upgrade 2 Packages 2026-02-18T03:14:03.111 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:03.111 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 1.3 M 2026-02-18T03:14:03.111 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-18T03:14:03.126 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:03.130 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:14:03.154 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:03.161 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:03.179 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:03.180 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:03.180 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:03.201 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install cephadm 2026-02-18T03:14:03.246 INFO:teuthology.orchestra.run.trial114.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 1.5 MB/s | 116 kB 00:00 2026-02-18T03:14:03.287 INFO:teuthology.orchestra.run.trial031.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 378 kB/s | 126 kB 00:00 2026-02-18T03:14:03.288 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:03.288 INFO:teuthology.orchestra.run.trial031.stdout:Total 376 kB/s | 126 kB 00:00 2026-02-18T03:14:03.288 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:14:03.292 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:14:03.292 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:14:03.309 INFO:teuthology.orchestra.run.trial114.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 8.4 MB/s | 1.2 MB 00:00 2026-02-18T03:14:03.309 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:03.309 INFO:teuthology.orchestra.run.trial114.stdout:Total 6.4 MB/s | 1.3 MB 00:00 2026-02-18T03:14:03.323 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:14:03.323 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:14:03.328 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-18T03:14:03.335 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-18T03:14:03.335 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-18T03:14:03.378 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:14:03.378 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-18T03:14:03.379 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-18T03:14:03.394 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:03.400 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:03.400 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:03.400 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:14:03.401 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:14:03.441 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-18T03:14:03.458 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:14:03.458 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:14:03.458 INFO:teuthology.orchestra.run.trial078.stdout:Upgraded: 2026-02-18T03:14:03.458 INFO:teuthology.orchestra.run.trial078.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:14:03.458 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-18T03:14:03.459 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-18T03:14:03.483 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:03.491 DEBUG:teuthology.parallel:result is None 2026-02-18T03:14:03.513 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:03.541 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:03.541 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:03.541 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:14:03.541 INFO:teuthology.orchestra.run.trial031.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:03.541 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:03.541 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:03.561 INFO:teuthology.orchestra.run.trial114.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:03.564 INFO:teuthology.orchestra.run.trial114.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:03.568 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install libcephfs2 2026-02-18T03:14:03.576 INFO:teuthology.orchestra.run.trial119.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:03.594 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:03.594 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:03.595 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:03.616 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:14:03.747 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:03.750 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:14:03.772 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:03.880 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:03.929 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:03.944 INFO:teuthology.orchestra.run.trial031.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:03.962 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:03.963 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:03.963 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:03.984 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install libcephfs-devel 2026-02-18T03:14:04.010 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:04.011 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:04.011 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-18T03:14:04.011 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:04.011 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 154 k 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 447 k 2026-02-18T03:14:04.012 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:14:04.021 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:04.021 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:04.021 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:14:04.021 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:14:04.078 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:14:04.078 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:04.078 INFO:teuthology.orchestra.run.trial114.stdout:Upgraded: 2026-02-18T03:14:04.078 INFO:teuthology.orchestra.run.trial114.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:14:04.078 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:14:04.078 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-18T03:14:04.105 INFO:teuthology.orchestra.run.trial119.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 1.6 MB/s | 154 kB 00:00 2026-02-18T03:14:04.106 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:04.106 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.6 MB/s | 154 kB 00:00 2026-02-18T03:14:04.106 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:14:04.112 DEBUG:teuthology.parallel:result is None 2026-02-18T03:14:04.113 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:14:04.114 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:14:04.144 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:14:04.144 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:14:04.199 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:14:04.201 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:14:04.223 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:14:04.223 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:14:04.223 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:14:04.223 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:04.299 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:04.380 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:04.381 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 34 k 2026-02-18T03:14:04.382 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 155 k 2026-02-18T03:14:04.383 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:14:04.450 INFO:teuthology.orchestra.run.trial031.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 508 kB/s | 34 kB 00:00 2026-02-18T03:14:04.450 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:04.450 INFO:teuthology.orchestra.run.trial031.stdout:Total 502 kB/s | 34 kB 00:00 2026-02-18T03:14:04.450 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:14:04.452 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:14:04.452 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:14:04.454 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:14:04.454 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:14:04.476 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:14:04.492 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:04.519 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:14:04.519 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:04.519 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:14:04.519 INFO:teuthology.orchestra.run.trial119.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:04.519 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:04.519 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:04.546 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr 2026-02-18T03:14:04.548 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:04.604 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:04.604 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:04.604 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:14:04.604 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:04.604 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:04.604 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:04.632 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librados2 2026-02-18T03:14:04.854 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:04.917 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:04.935 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:04.936 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:04.936 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:04.938 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:04.956 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:14:05.001 INFO:teuthology.orchestra.run.trial031.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:05.019 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:05.019 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:05.020 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:05.040 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librbd1 2026-02-18T03:14:05.273 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:05.337 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:05.353 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:05.355 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:05.355 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:05.355 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:05.376 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:14:05.417 INFO:teuthology.orchestra.run.trial031.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:05.435 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:05.436 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:05.436 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:05.457 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rados 2026-02-18T03:14:05.683 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:05.747 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:05.762 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:05.765 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:05.765 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:05.765 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:05.786 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:14:05.826 INFO:teuthology.orchestra.run.trial031.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:05.844 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:05.844 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:05.845 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:05.865 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rgw 2026-02-18T03:14:06.100 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:06.164 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:06.176 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:06.182 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:06.183 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:06.183 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:06.204 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:14:06.240 INFO:teuthology.orchestra.run.trial031.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:06.258 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:06.259 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:06.259 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:06.281 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-cephfs 2026-02-18T03:14:06.514 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:06.577 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:06.589 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:06.595 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:06.596 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:06.596 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:06.617 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-fuse 2026-02-18T03:14:06.653 INFO:teuthology.orchestra.run.trial031.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:06.671 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:06.671 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:06.672 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:06.693 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rbd 2026-02-18T03:14:06.926 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:07.002 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:07.009 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:07.010 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:07.010 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:07.010 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:07.010 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:14:07.010 INFO:teuthology.orchestra.run.trial119.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:14:07.011 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:07.011 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:14:07.011 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:07.011 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-18T03:14:07.011 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:07.011 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 942 k 2026-02-18T03:14:07.011 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 2.7 M 2026-02-18T03:14:07.011 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:14:07.066 INFO:teuthology.orchestra.run.trial031.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:07.084 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:07.084 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-18T03:14:07.084 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:07.106 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-fuse 2026-02-18T03:14:07.141 INFO:teuthology.orchestra.run.trial119.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 7.0 MB/s | 942 kB 00:00 2026-02-18T03:14:07.142 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:07.142 INFO:teuthology.orchestra.run.trial119.stdout:Total 7.0 MB/s | 942 kB 00:00 2026-02-18T03:14:07.142 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:14:07.146 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:14:07.146 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:14:07.180 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:14:07.180 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:14:07.269 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:14:07.287 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:07.417 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:07.499 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:07.500 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-18T03:14:07.501 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:07.501 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 91 k 2026-02-18T03:14:07.501 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 238 k 2026-02-18T03:14:07.501 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:14:07.528 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:07.573 INFO:teuthology.orchestra.run.trial031.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-18T03:14:07.574 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:07.574 INFO:teuthology.orchestra.run.trial031.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-18T03:14:07.574 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:14:07.578 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:14:07.578 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:14:07.584 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:07.584 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:07.584 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:14:07.585 INFO:teuthology.orchestra.run.trial119.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:07.585 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:07.585 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:07.609 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:14:07.610 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:14:07.612 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-volume 2026-02-18T03:14:07.661 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:14:07.678 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:07.759 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:07.816 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:07.816 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:07.816 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:14:07.816 INFO:teuthology.orchestra.run.trial031.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:07.816 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:07.817 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:07.845 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-mirror 2026-02-18T03:14:07.924 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:07.989 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:14:08.006 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:08.007 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:08.007 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:08.028 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librados-devel 2026-02-18T03:14:08.154 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:08.237 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:08.238 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-18T03:14:08.239 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:08.239 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 2.9 M 2026-02-18T03:14:08.239 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 11 M 2026-02-18T03:14:08.239 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:14:08.339 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:08.419 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:08.420 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:08.420 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 126 k 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 449 k 2026-02-18T03:14:08.421 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:14:08.793 INFO:teuthology.orchestra.run.trial119.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 338 kB/s | 126 kB 00:00 2026-02-18T03:14:08.793 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:08.793 INFO:teuthology.orchestra.run.trial119.stdout:Total 337 kB/s | 126 kB 00:00 2026-02-18T03:14:08.793 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:14:08.796 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:14:08.796 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:14:08.827 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:14:08.827 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:14:08.882 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:14:08.898 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:08.975 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:09.032 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:09.032 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:09.032 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:14:09.032 INFO:teuthology.orchestra.run.trial119.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:09.033 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:09.033 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:09.060 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install libcephfs2 2026-02-18T03:14:09.153 INFO:teuthology.orchestra.run.trial031.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 3.2 MB/s | 2.9 MB 00:00 2026-02-18T03:14:09.154 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:09.154 INFO:teuthology.orchestra.run.trial031.stdout:Total 3.2 MB/s | 2.9 MB 00:00 2026-02-18T03:14:09.154 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:14:09.159 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:14:09.159 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:14:09.198 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:14:09.198 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:14:09.372 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:09.377 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:14:09.379 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:09.401 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:09.401 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:14:09.401 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:14:09.401 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:14:09.401 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:14:09.401 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:09.436 INFO:teuthology.orchestra.run.trial119.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:09.454 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:09.455 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:09.455 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:09.476 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install libcephfs-devel 2026-02-18T03:14:09.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:09.712 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:09.713 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:14:09.713 INFO:teuthology.orchestra.run.trial031.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:09.713 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:09.713 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:09.741 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-nbd 2026-02-18T03:14:09.783 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:09.866 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:09.866 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:09.866 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-18T03:14:09.866 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:09.866 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:14:09.866 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:14:09.867 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:09.867 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:14:09.867 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:09.867 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-18T03:14:09.867 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:09.867 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 34 k 2026-02-18T03:14:09.867 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 155 k 2026-02-18T03:14:09.867 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:14:09.928 INFO:teuthology.orchestra.run.trial119.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 553 kB/s | 34 kB 00:00 2026-02-18T03:14:09.929 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:09.929 INFO:teuthology.orchestra.run.trial119.stdout:Total 541 kB/s | 34 kB 00:00 2026-02-18T03:14:09.930 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:14:09.932 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:14:09.932 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:14:09.934 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:14:09.934 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:14:09.954 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:14:09.970 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:10.030 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:10.059 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:10.087 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:10.087 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:10.088 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:14:10.088 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:10.088 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:10.088 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:10.114 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librados2 2026-02-18T03:14:10.142 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:10.143 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:10.143 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:10.143 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:10.143 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-18T03:14:10.143 INFO:teuthology.orchestra.run.trial031.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:14:10.143 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:10.144 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:14:10.144 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:10.144 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-18T03:14:10.144 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:10.144 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 180 k 2026-02-18T03:14:10.144 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 498 k 2026-02-18T03:14:10.144 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:14:10.238 INFO:teuthology.orchestra.run.trial031.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 1.8 MB/s | 180 kB 00:00 2026-02-18T03:14:10.239 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:10.240 INFO:teuthology.orchestra.run.trial031.stdout:Total 1.8 MB/s | 180 kB 00:00 2026-02-18T03:14:10.240 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:14:10.244 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:14:10.244 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:14:10.276 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:14:10.276 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:14:10.332 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:14:10.349 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:10.424 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:10.428 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:10.487 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:10.487 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:10.487 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-18T03:14:10.488 INFO:teuthology.orchestra.run.trial031.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:10.488 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:10.488 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:10.488 INFO:teuthology.orchestra.run.trial119.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:10.506 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:10.507 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:10.507 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:10.518 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install nvme-cli 2026-02-18T03:14:10.529 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librbd1 2026-02-18T03:14:10.834 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:14:10.841 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:10.899 INFO:teuthology.orchestra.run.trial031.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:14:10.907 INFO:teuthology.orchestra.run.trial119.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:10.917 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-18T03:14:10.918 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:10.918 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:10.918 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:10.918 INFO:teuthology.orchestra.run.trial031.stdout:Upgrading: 2026-02-18T03:14:10.918 INFO:teuthology.orchestra.run.trial031.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:14:10.918 INFO:teuthology.orchestra.run.trial031.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:14:10.918 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:10.919 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-18T03:14:10.919 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-18T03:14:10.919 INFO:teuthology.orchestra.run.trial031.stdout:Upgrade 2 Packages 2026-02-18T03:14:10.919 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:10.919 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 1.3 M 2026-02-18T03:14:10.919 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-18T03:14:10.924 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:10.925 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:10.925 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:10.947 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rados 2026-02-18T03:14:11.024 INFO:teuthology.orchestra.run.trial031.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 6.5 MB/s | 116 kB 00:00 2026-02-18T03:14:11.040 INFO:teuthology.orchestra.run.trial031.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 35 MB/s | 1.2 MB 00:00 2026-02-18T03:14:11.040 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:11.040 INFO:teuthology.orchestra.run.trial031.stdout:Total 10 MB/s | 1.3 MB 00:00 2026-02-18T03:14:11.059 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-18T03:14:11.065 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-18T03:14:11.066 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-18T03:14:11.108 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-18T03:14:11.108 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-18T03:14:11.171 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-18T03:14:11.259 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:11.292 INFO:teuthology.orchestra.run.trial031.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:11.295 INFO:teuthology.orchestra.run.trial031.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:11.325 INFO:teuthology.orchestra.run.trial119.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:11.342 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:11.342 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:11.343 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:11.364 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rgw 2026-02-18T03:14:11.472 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:11.476 INFO:teuthology.orchestra.run.trial031.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:14:11.498 INFO:teuthology.orchestra.run.trial031.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:11.672 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:11.736 INFO:teuthology.orchestra.run.trial119.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:11.754 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:11.754 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:11.754 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:14:11.754 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:14:11.755 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:11.755 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:11.755 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:11.776 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-cephfs 2026-02-18T03:14:11.811 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:14:11.811 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:11.811 INFO:teuthology.orchestra.run.trial031.stdout:Upgraded: 2026-02-18T03:14:11.811 INFO:teuthology.orchestra.run.trial031.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:14:11.811 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-18T03:14:11.812 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-18T03:14:11.845 DEBUG:teuthology.parallel:result is None 2026-02-18T03:14:12.081 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:12.145 INFO:teuthology.orchestra.run.trial119.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:12.163 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:12.163 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:12.164 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:12.186 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rbd 2026-02-18T03:14:12.497 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:12.562 INFO:teuthology.orchestra.run.trial119.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:14:12.580 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:12.581 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-18T03:14:12.581 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:12.602 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-fuse 2026-02-18T03:14:12.913 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:12.995 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:12.996 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:12.996 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:12.996 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:12.996 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:14:12.996 INFO:teuthology.orchestra.run.trial119.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:14:12.996 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:12.996 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:14:12.997 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:12.997 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-18T03:14:12.997 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:12.997 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 91 k 2026-02-18T03:14:12.997 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 238 k 2026-02-18T03:14:12.997 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:14:13.069 INFO:teuthology.orchestra.run.trial119.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-18T03:14:13.070 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:13.070 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-18T03:14:13.070 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:14:13.074 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:14:13.074 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:14:13.105 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:14:13.105 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:14:13.156 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:14:13.173 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:13.251 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:13.309 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:13.309 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:13.309 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:14:13.309 INFO:teuthology.orchestra.run.trial119.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:13.309 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:13.309 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:13.338 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-mirror 2026-02-18T03:14:13.660 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:13.742 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:13.743 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:13.743 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-18T03:14:13.743 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:13.743 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:14:13.743 INFO:teuthology.orchestra.run.trial119.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:14:13.743 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:13.744 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:14:13.744 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:13.744 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-18T03:14:13.744 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:13.744 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 2.9 M 2026-02-18T03:14:13.744 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 11 M 2026-02-18T03:14:13.744 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:14:15.060 INFO:teuthology.orchestra.run.trial119.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 2.2 MB/s | 2.9 MB 00:01 2026-02-18T03:14:15.062 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:15.062 INFO:teuthology.orchestra.run.trial119.stdout:Total 2.2 MB/s | 2.9 MB 00:01 2026-02-18T03:14:15.062 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:14:15.067 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:14:15.067 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:14:15.107 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:14:15.107 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:14:15.292 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:14:15.293 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:15.316 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:15.317 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:14:15.317 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:14:15.317 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:14:15.317 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:14:15.317 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:15.628 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:15.628 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:15.629 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:14:15.629 INFO:teuthology.orchestra.run.trial119.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:15.629 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:15.629 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:15.657 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-nbd 2026-02-18T03:14:15.968 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:16.050 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:16.051 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:16.051 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:16.051 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:16.051 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-18T03:14:16.051 INFO:teuthology.orchestra.run.trial119.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:14:16.052 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:16.052 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:14:16.052 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:16.052 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-18T03:14:16.052 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:16.052 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 180 k 2026-02-18T03:14:16.052 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 498 k 2026-02-18T03:14:16.052 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:14:16.279 INFO:teuthology.orchestra.run.trial119.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 794 kB/s | 180 kB 00:00 2026-02-18T03:14:16.279 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:16.280 INFO:teuthology.orchestra.run.trial119.stdout:Total 789 kB/s | 180 kB 00:00 2026-02-18T03:14:16.280 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:14:16.284 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:14:16.284 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:14:16.315 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:14:16.316 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:14:16.371 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:14:16.388 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:16.466 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:16.523 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:14:16.523 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:16.524 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-18T03:14:16.524 INFO:teuthology.orchestra.run.trial119.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:14:16.524 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:16.524 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:16.551 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install nvme-cli 2026-02-18T03:14:16.857 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:13:23 AM UTC. 2026-02-18T03:14:16.921 INFO:teuthology.orchestra.run.trial119.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:14:16.939 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-18T03:14:16.940 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:16.940 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-18T03:14:16.940 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:16.940 INFO:teuthology.orchestra.run.trial119.stdout:Upgrading: 2026-02-18T03:14:16.940 INFO:teuthology.orchestra.run.trial119.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:14:16.940 INFO:teuthology.orchestra.run.trial119.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:14:16.940 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:16.941 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-18T03:14:16.941 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-18T03:14:16.941 INFO:teuthology.orchestra.run.trial119.stdout:Upgrade 2 Packages 2026-02-18T03:14:16.941 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:16.941 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 1.3 M 2026-02-18T03:14:16.941 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-18T03:14:17.428 INFO:teuthology.orchestra.run.trial119.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 634 kB/s | 116 kB 00:00 2026-02-18T03:14:17.508 INFO:teuthology.orchestra.run.trial119.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 4.4 MB/s | 1.2 MB 00:00 2026-02-18T03:14:17.508 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:17.508 INFO:teuthology.orchestra.run.trial119.stdout:Total 2.2 MB/s | 1.3 MB 00:00 2026-02-18T03:14:17.526 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-18T03:14:17.532 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-18T03:14:17.532 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-18T03:14:17.574 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-18T03:14:17.575 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-18T03:14:17.637 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-18T03:14:17.757 INFO:teuthology.orchestra.run.trial119.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:17.759 INFO:teuthology.orchestra.run.trial119.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:17.941 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:14:17.944 INFO:teuthology.orchestra.run.trial119.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:14:17.967 INFO:teuthology.orchestra.run.trial119.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:18.211 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:14:18.211 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:14:18.211 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:14:18.211 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:14:18.269 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:14:18.269 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:18.269 INFO:teuthology.orchestra.run.trial119.stdout:Upgraded: 2026-02-18T03:14:18.269 INFO:teuthology.orchestra.run.trial119.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:14:18.269 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:14:18.269 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-18T03:14:18.301 DEBUG:teuthology.parallel:result is None 2026-02-18T03:14:18.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:18.478 DEBUG:teuthology.orchestra.run.trial031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:14:18.501 INFO:teuthology.orchestra.run.trial031.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:14:18.501 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:14:18.502 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:14:18.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:18.639 DEBUG:teuthology.orchestra.run.trial078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:14:18.661 INFO:teuthology.orchestra.run.trial078.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:14:18.662 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:14:18.662 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:14:18.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:18.802 DEBUG:teuthology.orchestra.run.trial097:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:14:18.824 INFO:teuthology.orchestra.run.trial097.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:14:18.824 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:14:18.824 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:14:18.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:18.978 DEBUG:teuthology.orchestra.run.trial114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:14:19.001 INFO:teuthology.orchestra.run.trial114.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:14:19.001 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:14:19.001 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:14:19.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:19.142 DEBUG:teuthology.orchestra.run.trial119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:14:19.165 INFO:teuthology.orchestra.run.trial119.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:14:19.165 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:14:19.165 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:14:19.167 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:19.300 DEBUG:teuthology.orchestra.run.trial194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:14:19.323 INFO:teuthology.orchestra.run.trial194.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:14:19.323 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:14:19.323 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:14:19.325 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-18T03:14:19.325 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:14:19.325 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:14:19.352 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:14:19.352 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:14:19.380 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:14:19.380 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:14:19.408 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:14:19.408 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:14:19.436 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:14:19.436 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:14:19.465 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:14:19.465 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:14:19.494 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-18T03:14:19.495 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:14:19.495 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:14:19.521 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:14:19.584 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:14:19.585 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:14:19.609 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:14:19.673 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:14:19.673 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:14:19.699 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:14:19.767 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:14:19.767 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:14:19.791 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:14:19.855 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:14:19.856 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:14:19.882 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:14:19.945 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:14:19.946 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:14:19.972 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:14:20.038 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-18T03:14:20.039 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:14:20.039 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:14:20.065 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:14:20.131 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:14:20.131 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:14:20.156 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:14:20.220 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:14:20.220 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:14:20.246 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:14:20.312 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:14:20.313 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:14:20.338 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:14:20.402 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:14:20.402 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:14:20.428 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:14:20.491 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:14:20.491 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:14:20.517 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:14:20.585 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-18T03:14:20.585 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:14:20.585 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:14:20.611 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:14:20.675 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:14:20.675 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:14:20.701 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:14:20.765 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:14:20.765 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:14:20.791 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:14:20.854 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:14:20.854 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:14:20.879 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:14:20.943 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:14:20.944 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:14:20.970 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:14:21.034 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:14:21.034 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:14:21.060 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:14:21.125 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-18T03:14:21.287 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'OSD_DOWN', 'OSD_HOST_DOWN', 'OSD_ROOT_DOWN', 'PG_DEGRADED', 'NVMEOF_SINGLE_GATEWAY', 'CEPHADM_FAILED_DAEMON'], 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'} 2026-02-18T03:14:21.288 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:21.291 INFO:tasks.cephadm:Cluster fsid is eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:21.291 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-18T03:14:21.291 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.97', 'mon.b': '10.20.193.114', 'mon.c': '10.20.193.119'} 2026-02-18T03:14:21.291 INFO:tasks.cephadm:First mon is mon.a on trial097 2026-02-18T03:14:21.291 INFO:tasks.cephadm:First mgr is x 2026-02-18T03:14:21.291 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-18T03:14:21.291 DEBUG:teuthology.orchestra.run.trial031:> sudo hostname $(hostname -s) 2026-02-18T03:14:21.316 DEBUG:teuthology.orchestra.run.trial078:> sudo hostname $(hostname -s) 2026-02-18T03:14:21.341 DEBUG:teuthology.orchestra.run.trial097:> sudo hostname $(hostname -s) 2026-02-18T03:14:21.366 DEBUG:teuthology.orchestra.run.trial114:> sudo hostname $(hostname -s) 2026-02-18T03:14:21.392 DEBUG:teuthology.orchestra.run.trial119:> sudo hostname $(hostname -s) 2026-02-18T03:14:21.418 DEBUG:teuthology.orchestra.run.trial194:> sudo hostname $(hostname -s) 2026-02-18T03:14:21.445 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-18T03:14:21.445 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:21.605 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/', 'ref': '20.2.1_2.17.26-baseline_2', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-17 18:19:08.791671', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '20.2.0-670-gadc19233', 'package_manager_version': '20.2.0-670.gadc19233', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3038/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-18T03:14:21.754 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref 20.2.1_2.17.26-baseline_2, sha1 adc1923395f2bcd6ae89b5d331d278364d1848ed from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:21.756 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm 2026-02-18T03:14:21.757 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm 2026-02-18T03:14:21.757 DEBUG:teuthology.orchestra.run.trial031:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:22.019 INFO:teuthology.orchestra.run.trial031.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:14 /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:22.019 DEBUG:teuthology.orchestra.run.trial078:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:22.292 INFO:teuthology.orchestra.run.trial078.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:14 /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:22.293 DEBUG:teuthology.orchestra.run.trial097:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:22.556 INFO:teuthology.orchestra.run.trial097.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:14 /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:22.556 DEBUG:teuthology.orchestra.run.trial114:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:22.842 INFO:teuthology.orchestra.run.trial114.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:14 /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:22.842 DEBUG:teuthology.orchestra.run.trial119:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.103 INFO:teuthology.orchestra.run.trial119.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:14 /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.104 DEBUG:teuthology.orchestra.run.trial194:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.389 INFO:teuthology.orchestra.run.trial194.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:14 /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.390 DEBUG:teuthology.orchestra.run.trial031:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.409 DEBUG:teuthology.orchestra.run.trial078:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.428 DEBUG:teuthology.orchestra.run.trial097:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.446 DEBUG:teuthology.orchestra.run.trial114:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.465 DEBUG:teuthology.orchestra.run.trial119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.484 DEBUG:teuthology.orchestra.run.trial194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:14:23.526 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed on all hosts... 2026-02-18T03:14:23.526 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:14:23.529 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:14:23.531 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:14:23.534 DEBUG:teuthology.orchestra.run.trial114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:14:23.537 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:14:23.539 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:14:23.680 INFO:teuthology.orchestra.run.trial031.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:14:23.684 INFO:teuthology.orchestra.run.trial097.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:14:23.688 INFO:teuthology.orchestra.run.trial078.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:14:23.691 INFO:teuthology.orchestra.run.trial119.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:14:23.693 INFO:teuthology.orchestra.run.trial114.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:14:23.695 INFO:teuthology.orchestra.run.trial194.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:14:32.378 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-18T03:14:32.379 INFO:teuthology.orchestra.run.trial078.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:14:32.379 INFO:teuthology.orchestra.run.trial078.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:14:32.379 INFO:teuthology.orchestra.run.trial078.stdout: "repo_digests": [ 2026-02-18T03:14:32.379 INFO:teuthology.orchestra.run.trial078.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:14:32.379 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-18T03:14:32.379 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-18T03:14:32.456 INFO:teuthology.orchestra.run.trial119.stdout:{ 2026-02-18T03:14:32.456 INFO:teuthology.orchestra.run.trial119.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:14:32.456 INFO:teuthology.orchestra.run.trial119.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:14:32.457 INFO:teuthology.orchestra.run.trial119.stdout: "repo_digests": [ 2026-02-18T03:14:32.457 INFO:teuthology.orchestra.run.trial119.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:14:32.457 INFO:teuthology.orchestra.run.trial119.stdout: ] 2026-02-18T03:14:32.457 INFO:teuthology.orchestra.run.trial119.stdout:} 2026-02-18T03:14:32.467 INFO:teuthology.orchestra.run.trial114.stdout:{ 2026-02-18T03:14:32.468 INFO:teuthology.orchestra.run.trial114.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:14:32.468 INFO:teuthology.orchestra.run.trial114.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:14:32.468 INFO:teuthology.orchestra.run.trial114.stdout: "repo_digests": [ 2026-02-18T03:14:32.468 INFO:teuthology.orchestra.run.trial114.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:14:32.468 INFO:teuthology.orchestra.run.trial114.stdout: ] 2026-02-18T03:14:32.468 INFO:teuthology.orchestra.run.trial114.stdout:} 2026-02-18T03:14:32.526 INFO:teuthology.orchestra.run.trial097.stdout:{ 2026-02-18T03:14:32.526 INFO:teuthology.orchestra.run.trial097.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:14:32.526 INFO:teuthology.orchestra.run.trial097.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:14:32.526 INFO:teuthology.orchestra.run.trial097.stdout: "repo_digests": [ 2026-02-18T03:14:32.526 INFO:teuthology.orchestra.run.trial097.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:14:32.527 INFO:teuthology.orchestra.run.trial097.stdout: ] 2026-02-18T03:14:32.527 INFO:teuthology.orchestra.run.trial097.stdout:} 2026-02-18T03:14:33.638 INFO:teuthology.orchestra.run.trial031.stdout:{ 2026-02-18T03:14:33.638 INFO:teuthology.orchestra.run.trial031.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:14:33.638 INFO:teuthology.orchestra.run.trial031.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:14:33.638 INFO:teuthology.orchestra.run.trial031.stdout: "repo_digests": [ 2026-02-18T03:14:33.638 INFO:teuthology.orchestra.run.trial031.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:14:33.638 INFO:teuthology.orchestra.run.trial031.stdout: ] 2026-02-18T03:14:33.638 INFO:teuthology.orchestra.run.trial031.stdout:} 2026-02-18T03:14:35.156 INFO:teuthology.orchestra.run.trial194.stdout:{ 2026-02-18T03:14:35.157 INFO:teuthology.orchestra.run.trial194.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:14:35.157 INFO:teuthology.orchestra.run.trial194.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:14:35.157 INFO:teuthology.orchestra.run.trial194.stdout: "repo_digests": [ 2026-02-18T03:14:35.157 INFO:teuthology.orchestra.run.trial194.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:14:35.157 INFO:teuthology.orchestra.run.trial194.stdout: ] 2026-02-18T03:14:35.157 INFO:teuthology.orchestra.run.trial194.stdout:} 2026-02-18T03:14:35.174 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /etc/ceph 2026-02-18T03:14:35.203 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /etc/ceph 2026-02-18T03:14:35.232 DEBUG:teuthology.orchestra.run.trial097:> sudo mkdir -p /etc/ceph 2026-02-18T03:14:35.261 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /etc/ceph 2026-02-18T03:14:35.289 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /etc/ceph 2026-02-18T03:14:35.320 DEBUG:teuthology.orchestra.run.trial194:> sudo mkdir -p /etc/ceph 2026-02-18T03:14:35.347 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod 777 /etc/ceph 2026-02-18T03:14:35.372 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 777 /etc/ceph 2026-02-18T03:14:35.397 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod 777 /etc/ceph 2026-02-18T03:14:35.424 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 777 /etc/ceph 2026-02-18T03:14:35.450 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 777 /etc/ceph 2026-02-18T03:14:35.476 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod 777 /etc/ceph 2026-02-18T03:14:35.500 INFO:tasks.cephadm:Writing seed config... 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [global] mon warn on pool no app = False 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-18T03:14:35.501 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-18T03:14:35.501 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:14:35.501 DEBUG:teuthology.orchestra.run.trial097:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-18T03:14:35.518 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = eb431a19-0c77-11f1-b2a8-d404e6e7d460 mon warn on pool no app = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-18T03:14:35.518 DEBUG:teuthology.orchestra.run.trial097:mon.a> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.a.service 2026-02-18T03:14:35.560 DEBUG:teuthology.orchestra.run.trial097:mgr.x> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mgr.x.service 2026-02-18T03:14:35.602 INFO:tasks.cephadm:Bootstrapping... 2026-02-18T03:14:35.602 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed -v bootstrap --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.97 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:14:35.741 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:14:35.741 INFO:teuthology.orchestra.run.trial097.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed', '-v', 'bootstrap', '--fsid', 'eb431a19-0c77-11f1-b2a8-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.97', '--skip-admin-label'] 2026-02-18T03:14:35.741 INFO:teuthology.orchestra.run.trial097.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-18T03:14:35.741 INFO:teuthology.orchestra.run.trial097.stdout:Verifying podman|docker is present... 2026-02-18T03:14:35.757 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stdout 5.6.0 2026-02-18T03:14:35.757 INFO:teuthology.orchestra.run.trial097.stdout:Verifying lvm2 is present... 2026-02-18T03:14:35.757 INFO:teuthology.orchestra.run.trial097.stdout:Verifying time synchronization is in place... 2026-02-18T03:14:35.763 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-18T03:14:35.763 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-18T03:14:35.769 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-18T03:14:35.769 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout inactive 2026-02-18T03:14:35.775 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout enabled 2026-02-18T03:14:35.781 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout active 2026-02-18T03:14:35.781 INFO:teuthology.orchestra.run.trial097.stdout:Unit chronyd.service is enabled and running 2026-02-18T03:14:35.781 INFO:teuthology.orchestra.run.trial097.stdout:Repeating the final host check... 2026-02-18T03:14:35.796 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stdout 5.6.0 2026-02-18T03:14:35.796 INFO:teuthology.orchestra.run.trial097.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-18T03:14:35.796 INFO:teuthology.orchestra.run.trial097.stdout:systemctl is present 2026-02-18T03:14:35.796 INFO:teuthology.orchestra.run.trial097.stdout:lvcreate is present 2026-02-18T03:14:35.802 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-18T03:14:35.802 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-18T03:14:35.808 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-18T03:14:35.808 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout inactive 2026-02-18T03:14:35.814 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout enabled 2026-02-18T03:14:35.819 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout active 2026-02-18T03:14:35.819 INFO:teuthology.orchestra.run.trial097.stdout:Unit chronyd.service is enabled and running 2026-02-18T03:14:35.820 INFO:teuthology.orchestra.run.trial097.stdout:Host looks OK 2026-02-18T03:14:35.820 INFO:teuthology.orchestra.run.trial097.stdout:Cluster fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:35.820 INFO:teuthology.orchestra.run.trial097.stdout:Acquiring lock 139929493213968 on /run/cephadm/eb431a19-0c77-11f1-b2a8-d404e6e7d460.lock 2026-02-18T03:14:35.820 INFO:teuthology.orchestra.run.trial097.stdout:Lock 139929493213968 acquired on /run/cephadm/eb431a19-0c77-11f1-b2a8-d404e6e7d460.lock 2026-02-18T03:14:35.820 INFO:teuthology.orchestra.run.trial097.stdout:Verifying IP 10.20.193.97 port 3300 ... 2026-02-18T03:14:35.820 INFO:teuthology.orchestra.run.trial097.stdout:Verifying IP 10.20.193.97 port 6789 ... 2026-02-18T03:14:35.820 INFO:teuthology.orchestra.run.trial097.stdout:Base mon IP(s) is [10.20.193.97:3300, 10.20.193.97:6789], mon addrv is [v2:10.20.193.97:3300,v1:10.20.193.97:6789] 2026-02-18T03:14:35.823 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.97 metric 102 2026-02-18T03:14:35.824 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.97 metric 102 2026-02-18T03:14:35.824 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-18T03:14:35.826 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-18T03:14:35.826 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-18T03:14:35.826 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout inet6 fe80::5955:fe34:915e:b389/64 scope link noprefixroute 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:64c8/64 scope link 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-18T03:14:35.829 INFO:teuthology.orchestra.run.trial097.stdout:Mon IP `10.20.193.97` is in CIDR network `10.20.192.0/20` 2026-02-18T03:14:35.830 INFO:teuthology.orchestra.run.trial097.stdout:Mon IP `10.20.193.97` is in CIDR network `10.20.192.0/20` 2026-02-18T03:14:35.830 INFO:teuthology.orchestra.run.trial097.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-18T03:14:35.830 INFO:teuthology.orchestra.run.trial097.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-18T03:14:35.830 INFO:teuthology.orchestra.run.trial097.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:14:36.068 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stdout c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc 2026-02-18T03:14:36.068 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:14:36.068 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stderr Getting image source signatures 2026-02-18T03:14:36.069 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stderr Copying blob sha256:ddefcddf6ef03d04de1b3dcc9836d89822cd11e5095471fffeae38220180f545 2026-02-18T03:14:36.069 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stderr Copying blob sha256:5dd85e1a50663785d86adae5ef92579a03e6f64059ca9c005010518acdd62048 2026-02-18T03:14:36.069 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stderr Copying config sha256:c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc 2026-02-18T03:14:36.069 INFO:teuthology.orchestra.run.trial097.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-18T03:14:36.185 INFO:teuthology.orchestra.run.trial097.stdout:ceph: stdout ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable) 2026-02-18T03:14:36.185 INFO:teuthology.orchestra.run.trial097.stdout:Ceph version: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable) 2026-02-18T03:14:36.185 INFO:teuthology.orchestra.run.trial097.stdout:Extracting ceph user uid/gid from container image... 2026-02-18T03:14:36.325 INFO:teuthology.orchestra.run.trial097.stdout:stat: stdout 167 167 2026-02-18T03:14:36.325 INFO:teuthology.orchestra.run.trial097.stdout:Creating initial keys... 2026-02-18T03:14:36.459 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph-authtool: stdout AQCcLpVpaluwGhAAIPPC4H3jD30IqnNNb92B1w== 2026-02-18T03:14:36.595 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph-authtool: stdout AQCcLpVpLwvNIhAAAxf+yPQkXsG7VB0/Z8FVxQ== 2026-02-18T03:14:36.714 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph-authtool: stdout AQCcLpVphA++KRAAHjQ6USDGbOQxKt/cBVm+oQ== 2026-02-18T03:14:36.715 INFO:teuthology.orchestra.run.trial097.stdout:Creating initial monmap... 2026-02-18T03:14:36.853 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-18T03:14:36.853 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-18T03:14:36.854 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:36.854 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-18T03:14:36.854 INFO:teuthology.orchestra.run.trial097.stdout:monmaptool for a [v2:10.20.193.97:3300,v1:10.20.193.97:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-18T03:14:36.854 INFO:teuthology.orchestra.run.trial097.stdout:setting min_mon_release = tentacle 2026-02-18T03:14:36.854 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/monmaptool: set fsid to eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:36.854 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-18T03:14:36.854 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:14:36.854 INFO:teuthology.orchestra.run.trial097.stdout:Creating mon... 2026-02-18T03:14:36.980 INFO:teuthology.orchestra.run.trial097.stdout:create mon.a on 2026-02-18T03:14:37.144 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-18T03:14:37.246 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-18T03:14:37.350 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460.target → /etc/systemd/system/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460.target. 2026-02-18T03:14:37.350 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460.target → /etc/systemd/system/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460.target. 2026-02-18T03:14:37.471 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.a 2026-02-18T03:14:37.471 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Failed to reset failed state of unit ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.a.service: Unit ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.a.service not loaded. 2026-02-18T03:14:37.596 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460.target.wants/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@.service. 2026-02-18T03:14:37.728 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:37 trial097 podman[21341]: 2026-02-18 03:14:37.729228723 +0000 UTC m=+0.045356288 container init fa465156911fd222915a283fb53a3f8f21efdf5f07dd380a6508260423b57311 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:14:37.744 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-18T03:14:37.744 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout disabled 2026-02-18T03:14:37.751 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-18T03:14:37.751 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout inactive 2026-02-18T03:14:37.751 INFO:teuthology.orchestra.run.trial097.stdout:firewalld.service is not enabled 2026-02-18T03:14:37.751 INFO:teuthology.orchestra.run.trial097.stdout:Not possible to enable service . firewalld.service is not available 2026-02-18T03:14:37.751 INFO:teuthology.orchestra.run.trial097.stdout:Waiting for mon to start... 2026-02-18T03:14:37.751 INFO:teuthology.orchestra.run.trial097.stdout:Waiting for mon... 2026-02-18T03:14:37.926 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout cluster: 2026-02-18T03:14:37.926 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout id: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:37.926 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-18T03:14:37.926 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:37.926 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout services: 2026-02-18T03:14:37.926 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.136354s) [leader: a] 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout data: 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout pgs: 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:mon is available 2026-02-18T03:14:37.927 INFO:teuthology.orchestra.run.trial097.stdout:Assimilating anything we can from ceph.conf... 2026-02-18T03:14:38.039 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:37 trial097 podman[21341]: 2026-02-18 03:14:37.731614985 +0000 UTC m=+0.047742540 container start fa465156911fd222915a283fb53a3f8f21efdf5f07dd380a6508260423b57311 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-18T03:14:38.039 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:37 trial097 bash[21341]: fa465156911fd222915a283fb53a3f8f21efdf5f07dd380a6508260423b57311 2026-02-18T03:14:38.039 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:37 trial097 podman[21341]: 2026-02-18 03:14:37.69295918 +0000 UTC m=+0.009086745 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:38.039 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:37 trial097 systemd[1]: Started Ceph mon.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:14:38.039 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:37 trial097 ceph-mon[21370]: mkfs eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:38.040 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:37 trial097 ceph-mon[21370]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-18T03:14:38.090 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:38.090 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout [global] 2026-02-18T03:14:38.090 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout fsid = eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:38.090 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-18T03:14:38.091 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.97:3300,v1:10.20.193.97:6789] 2026-02-18T03:14:38.091 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-18T03:14:38.091 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-18T03:14:38.091 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-18T03:14:38.091 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-18T03:14:38.091 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:38.091 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-18T03:14:38.092 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-18T03:14:38.092 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:38.092 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout [osd] 2026-02-18T03:14:38.092 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-18T03:14:38.092 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-18T03:14:38.092 INFO:teuthology.orchestra.run.trial097.stdout:Generating new minimal ceph.conf... 2026-02-18T03:14:38.265 INFO:teuthology.orchestra.run.trial097.stdout:Restarting the monitor... 2026-02-18T03:14:38.348 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 systemd[1]: Stopping Ceph mon.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:14:38.561 INFO:teuthology.orchestra.run.trial097.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-18T03:14:38.607 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a[21366]: 2026-02-18T03:14:38.348+0000 7f8ee6ddd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:14:38.607 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a[21366]: 2026-02-18T03:14:38.348+0000 7f8ee6ddd640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-18T03:14:38.607 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 podman[21648]: 2026-02-18 03:14:38.388744378 +0000 UTC m=+0.053490285 container died fa465156911fd222915a283fb53a3f8f21efdf5f07dd380a6508260423b57311 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 podman[21648]: 2026-02-18 03:14:38.396395733 +0000 UTC m=+0.061141640 container remove fa465156911fd222915a283fb53a3f8f21efdf5f07dd380a6508260423b57311 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , ceph=True, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 bash[21648]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 systemd[1]: Stopped Ceph mon.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 systemd[1]: Starting Ceph mon.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 podman[21772]: 2026-02-18 03:14:38.525886478 +0000 UTC m=+0.015733868 container create 02a2d25f1551ce1d1c404a4dad9cea5ddf818e0c4e9e3bf11c28ff1979649f22 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 podman[21772]: 2026-02-18 03:14:38.555249689 +0000 UTC m=+0.045097089 container init 02a2d25f1551ce1d1c404a4dad9cea5ddf818e0c4e9e3bf11c28ff1979649f22 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed) 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 podman[21772]: 2026-02-18 03:14:38.557606417 +0000 UTC m=+0.047453817 container start 02a2d25f1551ce1d1c404a4dad9cea5ddf818e0c4e9e3bf11c28ff1979649f22 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 bash[21772]: 02a2d25f1551ce1d1c404a4dad9cea5ddf818e0c4e9e3bf11c28ff1979649f22 2026-02-18T03:14:38.608 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 podman[21772]: 2026-02-18 03:14:38.519303934 +0000 UTC m=+0.009151334 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 systemd[1]: Started Ceph mon.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: pidfile_write: ignore empty --pid-file 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: load: jerasure load: lrc 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Git sha 0 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: DB SUMMARY 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: DB Session ID: 5Q7SV7B5J26DYCNF6B9B 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:14:38.609 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 76937 ; 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.env: 0x55abcd8d5100 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:14:38.610 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.info_log: 0x55abd2287b00 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.statistics: (nil) 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.use_fsync: 0 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:14:38.611 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.db_log_dir: 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.wal_dir: 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:14:38.612 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.write_buffer_manager: 0x55abd228a500 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.unordered_write: 0 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:14:38.613 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.row_cache: None 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.wal_filter: None 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.wal_compression: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:14:38.614 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:14:38.615 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_open_files: -1 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Compression algorithms supported: 2026-02-18T03:14:38.616 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: kZSTD supported: 0 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:14:38.617 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.merge_operator: 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_filter: None 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55abd2286240) 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout: index_type: 0 2026-02-18T03:14:38.618 INFO:journalctl@ceph.mon.a.trial097.stdout: data_block_index_type: 0 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: index_shortening: 1 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: checksum: 4 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: no_block_cache: 0 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: block_cache: 0x55abd22a7b90 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: block_cache_options: 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: capacity : 536870912 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: num_shard_bits : 4 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: strict_capacity_limit : 0 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:14:38.619 INFO:journalctl@ceph.mon.a.trial097.stdout: block_cache_compressed: (nil) 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: persistent_cache: (nil) 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: block_size: 4096 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: block_size_deviation: 10 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: block_restart_interval: 16 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: index_block_restart_interval: 1 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: metadata_block_size: 4096 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: partition_filters: 0 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: use_delta_encoding: 1 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: filter_policy: bloomfilter 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: whole_key_filtering: 1 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: verify_compression: 0 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:14:38.620 INFO:journalctl@ceph.mon.a.trial097.stdout: format_version: 5 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout: enable_index_compression: 1 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout: block_align: 0 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout: max_auto_readahead_size: 262144 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout: prepopulate_block_cache: 0 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression: NoCompression 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:14:38.621 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.num_levels: 7 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:14:38.622 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:14:38.623 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:14:38.624 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:14:38.625 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:14:38.626 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.ttl: 2592000 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:14:38.627 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f5d162ca-1f34-4800-96ae-13bbea03cdd5 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771384478586842, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771384478587724, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 73913, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 231, "table_properties": {"data_size": 72188, "index_size": 174, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9888, "raw_average_key_size": 48, "raw_value_size": 66623, "raw_average_value_size": 329, "num_data_blocks": 8, "num_entries": 202, "num_filter_entries": 202, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771384478, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f5d162ca-1f34-4800-96ae-13bbea03cdd5", "db_session_id": "5Q7SV7B5J26DYCNF6B9B", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771384478587793, "job": 1, "event": "recovery_finished"} 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-18T03:14:38.628 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55abd22aa700 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: DB pointer 0x55abd22bc000 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout: ** DB Stats ** 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:14:38.629 INFO:journalctl@ceph.mon.a.trial097.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: ** Compaction Stats [default] ** 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: L0 2/0 74.04 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: Sum 2/0 74.04 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: ** Compaction Stats [default] ** 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:14:38.630 INFO:journalctl@ceph.mon.a.trial097.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 109.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: Cumulative compaction: 0.00 GB write, 21.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: Interval compaction: 0.00 GB write, 21.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:14:38.631 INFO:journalctl@ceph.mon.a.trial097.stdout: Block cache BinnedLRUCache@0x55abd22a7b90#2 capacity: 512.00 MB usage: 1.08 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.72 KB,0.000137091%) IndexBlock(2,0.36 KB,6.85453e-05%) Misc(1,0.00 KB,0%) 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout: 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: starting mon.a rank 0 at public addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] at bind addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a@-1(???) e1 preinit fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a@-1(???).mds e1 new map 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a@-1(???).mds e1 print_map 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout: e1 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout: btime 2026-02-18T03:14:37:769894+0000 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:14:38.632 INFO:journalctl@ceph.mon.a.trial097.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:14:38.633 INFO:journalctl@ceph.mon.a.trial097.stdout: legacy client fscid: -1 2026-02-18T03:14:38.633 INFO:journalctl@ceph.mon.a.trial097.stdout: 2026-02-18T03:14:38.633 INFO:journalctl@ceph.mon.a.trial097.stdout: No filesystems configured 2026-02-18T03:14:38.633 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-18T03:14:38.633 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:14:38.633 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:14:38.633 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:14:38.633 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-18T03:14:38.733 INFO:teuthology.orchestra.run.trial097.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-18T03:14:38.734 INFO:teuthology.orchestra.run.trial097.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:14:38.734 INFO:teuthology.orchestra.run.trial097.stdout:Creating mgr... 2026-02-18T03:14:38.735 INFO:teuthology.orchestra.run.trial097.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-18T03:14:38.735 INFO:teuthology.orchestra.run.trial097.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-18T03:14:38.867 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mgr.x 2026-02-18T03:14:38.868 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Failed to reset failed state of unit ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mgr.x.service: Unit ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mgr.x.service not loaded. 2026-02-18T03:14:38.874 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-18T03:14:38.874 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: monmap epoch 1 2026-02-18T03:14:38.874 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:38.874 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: last_changed 2026-02-18T03:14:36.832353+0000 2026-02-18T03:14:38.874 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: created 2026-02-18T03:14:36.832353+0000 2026-02-18T03:14:38.874 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: min_mon_release 20 (tentacle) 2026-02-18T03:14:38.874 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: election_strategy: 1 2026-02-18T03:14:38.874 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: 0: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.a 2026-02-18T03:14:38.875 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: fsmap 2026-02-18T03:14:38.875 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: osdmap e1: 0 total, 0 up, 0 in 2026-02-18T03:14:38.875 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:38 trial097 ceph-mon[21799]: mgrmap e1: no daemons active 2026-02-18T03:14:38.983 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460.target.wants/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@.service. 2026-02-18T03:14:39.125 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-18T03:14:39.125 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout disabled 2026-02-18T03:14:39.132 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-18T03:14:39.132 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout inactive 2026-02-18T03:14:39.132 INFO:teuthology.orchestra.run.trial097.stdout:firewalld.service is not enabled 2026-02-18T03:14:39.132 INFO:teuthology.orchestra.run.trial097.stdout:Not possible to enable service . firewalld.service is not available 2026-02-18T03:14:39.139 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-18T03:14:39.139 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout disabled 2026-02-18T03:14:39.146 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-18T03:14:39.146 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout inactive 2026-02-18T03:14:39.146 INFO:teuthology.orchestra.run.trial097.stdout:firewalld.service is not enabled 2026-02-18T03:14:39.146 INFO:teuthology.orchestra.run.trial097.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-18T03:14:39.146 INFO:teuthology.orchestra.run.trial097.stdout:Waiting for mgr to start... 2026-02-18T03:14:39.146 INFO:teuthology.orchestra.run.trial097.stdout:Waiting for mgr... 2026-02-18T03:14:39.152 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:39 trial097 systemd[1]: Started Ceph mgr.x for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:14:39.326 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:39.326 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:14:39.326 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "fsid": "eb431a19-0c77-11f1-b2a8-d404e6e7d460", 2026-02-18T03:14:39.326 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "health": { 2026-02-18T03:14:39.326 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-18T03:14:39.326 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 0 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "a" 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-18T03:14:39.327 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-18T03:14:39.328 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-18T03:14:39.329 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "btime": "2026-02-18T03:14:37:769894+0000", 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:14:39.330 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:39.331 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-18T03:14:39.331 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:39.331 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "modified": "2026-02-18T03:14:37.770471+0000", 2026-02-18T03:14:39.331 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:14:39.331 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:39.331 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-18T03:14:39.331 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:14:39.331 INFO:teuthology.orchestra.run.trial097.stdout:mgr not available, waiting (1/15)... 2026-02-18T03:14:40.122 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:39 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2297050810' entity='client.admin' 2026-02-18T03:14:40.122 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:39 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3331177654' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:14:40.402 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-18T03:14:40.402 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-18T03:14:40.402 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: from numpy import show_config as show_numpy_config 2026-02-18T03:14:41.495 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:41.495 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:14:41.495 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "fsid": "eb431a19-0c77-11f1-b2a8-d404e6e7d460", 2026-02-18T03:14:41.495 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "health": { 2026-02-18T03:14:41.495 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-18T03:14:41.495 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 0 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "a" 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-18T03:14:41.496 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-18T03:14:41.497 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-18T03:14:41.498 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "btime": "2026-02-18T03:14:37:769894+0000", 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:14:41.499 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:41.500 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-18T03:14:41.500 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:41.500 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "modified": "2026-02-18T03:14:37.770471+0000", 2026-02-18T03:14:41.500 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:14:41.500 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:41.500 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-18T03:14:41.500 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:14:41.500 INFO:teuthology.orchestra.run.trial097.stdout:mgr not available, waiting (2/15)... 2026-02-18T03:14:41.652 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1818865884' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:14:42.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: Activating manager daemon x 2026-02-18T03:14:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: mgrmap e2: x(active, starting, since 0.00314488s) 2026-02-18T03:14:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:14:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:14:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:14:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:14:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:14:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: Manager daemon x is now available 2026-02-18T03:14:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:14:42.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' 2026-02-18T03:14:42.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:14:42.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' 2026-02-18T03:14:42.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:42 trial097 ceph-mon[21799]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' 2026-02-18T03:14:43.778 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:43.778 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:14:43.778 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "fsid": "eb431a19-0c77-11f1-b2a8-d404e6e7d460", 2026-02-18T03:14:43.778 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "health": { 2026-02-18T03:14:43.778 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-18T03:14:43.778 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 0 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "a" 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:43.779 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-18T03:14:43.780 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "btime": "2026-02-18T03:14:37:769894+0000", 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "modified": "2026-02-18T03:14:37.770471+0000", 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:14:43.781 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-18T03:14:43.782 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:14:43.782 INFO:teuthology.orchestra.run.trial097.stdout:mgr is available 2026-02-18T03:14:44.011 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:44.011 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout [global] 2026-02-18T03:14:44.011 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout fsid = eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.97:3300,v1:10.20.193.97:6789] 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-18T03:14:44.012 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-18T03:14:44.013 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 2026-02-18T03:14:44.013 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout [osd] 2026-02-18T03:14:44.013 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-18T03:14:44.013 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-18T03:14:44.013 INFO:teuthology.orchestra.run.trial097.stdout:Enabling cephadm module... 2026-02-18T03:14:44.030 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:43 trial097 ceph-mon[21799]: mgrmap e3: x(active, since 1.00583s) 2026-02-18T03:14:44.031 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:43 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/106808990' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:14:45.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:44 trial097 ceph-mon[21799]: mgrmap e4: x(active, since 2s) 2026-02-18T03:14:45.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2149291516' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-18T03:14:45.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3767280762' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-18T03:14:45.152 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: ignoring --setuser ceph since I am not root 2026-02-18T03:14:45.152 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: ignoring --setgroup ceph since I am not root 2026-02-18T03:14:45.202 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:14:45.202 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-18T03:14:45.202 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-18T03:14:45.202 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-18T03:14:45.202 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-18T03:14:45.202 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:14:45.202 INFO:teuthology.orchestra.run.trial097.stdout:Waiting for the mgr to restart... 2026-02-18T03:14:45.202 INFO:teuthology.orchestra.run.trial097.stdout:Waiting for mgr epoch 5... 2026-02-18T03:14:46.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3767280762' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-18T03:14:46.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:45 trial097 ceph-mon[21799]: mgrmap e5: x(active, since 3s) 2026-02-18T03:14:46.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2040890107' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-18T03:14:46.152 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-18T03:14:46.152 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-18T03:14:46.152 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: from numpy import show_config as show_numpy_config 2026-02-18T03:14:48.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: Active manager daemon x restarted 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: Activating manager daemon x 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: osdmap e2: 0 total, 0 up, 0 in 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: mgrmap e6: x(active, starting, since 0.00332489s) 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:14:48.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:47 trial097 ceph-mon[21799]: Manager daemon x is now available 2026-02-18T03:14:48.728 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:14:48.729 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-18T03:14:48.729 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-18T03:14:48.729 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:14:48.729 INFO:teuthology.orchestra.run.trial097.stdout:mgr epoch 5 is available 2026-02-18T03:14:48.729 INFO:teuthology.orchestra.run.trial097.stdout:Verifying orchestrator module is enabled... 2026-02-18T03:14:49.705 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:49.705 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:49.705 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: Found migration_current of "None". Setting to last migration. 2026-02-18T03:14:49.705 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:49.705 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:49.705 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:14:49.706 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:14:49.706 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:14:49.706 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:14:49.706 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-18T03:14:49.706 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: mgrmap e7: x(active, since 1.00396s) 2026-02-18T03:14:49.706 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-18T03:14:49.706 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:49 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2621589165' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-18T03:14:49.727 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-18T03:14:49.728 INFO:teuthology.orchestra.run.trial097.stdout:Setting orchestrator backend to cephadm... 2026-02-18T03:14:50.228 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-18T03:14:50.228 INFO:teuthology.orchestra.run.trial097.stdout:Generating ssh key... 2026-02-18T03:14:50.481 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:49] ENGINE Bus STARTING 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:49] ENGINE Serving on http://10.20.193.97:8765 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:49] ENGINE Serving on https://10.20.193.97:7150 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:49] ENGINE Bus STARTED 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:49] ENGINE Client ('10.20.193.97', 35230) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2621589165' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: mgrmap e8: x(active, since 2s) 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:50 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: Generating public/private ed25519 key pair. 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: Your identification has been saved in /tmp/tmpa5ooedsl/key 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: Your public key has been saved in /tmp/tmpa5ooedsl/key.pub 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: The key fingerprint is: 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: SHA256:xMUUQBaMNWDBLbk8BLhrElmz5IuZhkMhq1jZZ1dMUJ0 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: The key's randomart image is: 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: +--[ED25519 256]--+ 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: | ..o+XOX*o . | 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: |..= .*ooo+ E | 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: |.*.* o oo. | 2026-02-18T03:14:50.482 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: |+.* . *.. | 2026-02-18T03:14:50.483 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: |=* o o oS | 2026-02-18T03:14:50.483 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: |X.+ | 2026-02-18T03:14:50.483 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: |.+ | 2026-02-18T03:14:50.483 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: | | 2026-02-18T03:14:50.483 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: | | 2026-02-18T03:14:50.483 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: +----[SHA256]-----+ 2026-02-18T03:14:50.740 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:14:50.741 INFO:teuthology.orchestra.run.trial097.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:14:50.741 INFO:teuthology.orchestra.run.trial097.stdout:Adding key to root@localhost authorized_keys... 2026-02-18T03:14:50.741 INFO:teuthology.orchestra.run.trial097.stdout:Adding host trial097... 2026-02-18T03:14:51.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:51 trial097 ceph-mon[21799]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:14:51.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:51 trial097 ceph-mon[21799]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:14:51.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:51 trial097 ceph-mon[21799]: Generating ssh key... 2026-02-18T03:14:51.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:51 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:51.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:51 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:51.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:51 trial097 ceph-mon[21799]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:14:52.551 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout Added host 'trial097' with addr '10.20.193.97' 2026-02-18T03:14:52.551 INFO:teuthology.orchestra.run.trial097.stdout:Deploying unmanaged mon service... 2026-02-18T03:14:52.795 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:52 trial097 ceph-mon[21799]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial097", "addr": "10.20.193.97", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:14:52.795 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:52 trial097 ceph-mon[21799]: Deploying cephadm binary to trial097 2026-02-18T03:14:52.835 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-18T03:14:52.835 INFO:teuthology.orchestra.run.trial097.stdout:Deploying unmanaged mgr service... 2026-02-18T03:14:53.100 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: Added host trial097 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: Saving service mon spec with placement count:5 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:53.604 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:53.605 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/409575707' entity='client.admin' 2026-02-18T03:14:53.618 INFO:teuthology.orchestra.run.trial097.stdout:Enabling the dashboard module... 2026-02-18T03:14:54.876 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:54 trial097 ceph-mon[21799]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:14:54.877 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:54 trial097 ceph-mon[21799]: Saving service mgr spec with placement count:2 2026-02-18T03:14:54.877 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:54 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:54.877 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:54 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/208858833' entity='client.admin' 2026-02-18T03:14:54.877 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:54 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2502131834' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-18T03:14:54.877 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:54 trial097 ceph-mon[21799]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:14:54.877 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: ignoring --setuser ceph since I am not root 2026-02-18T03:14:54.877 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: ignoring --setgroup ceph since I am not root 2026-02-18T03:14:54.900 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:14:54.900 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-18T03:14:54.900 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-18T03:14:54.900 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-18T03:14:54.900 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-18T03:14:54.900 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:14:54.900 INFO:teuthology.orchestra.run.trial097.stdout:Waiting for the mgr to restart... 2026-02-18T03:14:54.900 INFO:teuthology.orchestra.run.trial097.stdout:Waiting for mgr epoch 9... 2026-02-18T03:14:55.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2502131834' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-18T03:14:55.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:55 trial097 ceph-mon[21799]: mgrmap e9: x(active, since 6s) 2026-02-18T03:14:55.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1267453173' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-18T03:14:55.903 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-18T03:14:55.904 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-18T03:14:55.904 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:14:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: from numpy import show_config as show_numpy_config 2026-02-18T03:14:57.901 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: Active manager daemon x restarted 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: Activating manager daemon x 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: osdmap e3: 0 total, 0 up, 0 in 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: mgrmap e10: x(active, starting, since 0.00349075s) 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:14:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:57 trial097 ceph-mon[21799]: Manager daemon x is now available 2026-02-18T03:14:58.439 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:14:58.439 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-18T03:14:58.439 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-18T03:14:58.439 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:14:58.439 INFO:teuthology.orchestra.run.trial097.stdout:mgr epoch 9 is available 2026-02-18T03:14:58.439 INFO:teuthology.orchestra.run.trial097.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-18T03:14:58.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:14:58.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:14:58.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:14:58.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:14:58.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:58 trial097 ceph-mon[21799]: mgrmap e11: x(active, since 1.00557s) 2026-02-18T03:14:58.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:14:58.960 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUNIb+KhfsanHLszwi1gwFIzS5NiowDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI2MDIxODAzMTQ1OFoXDTI5\nMDIxNzAzMTQ1OFowFzEVMBMGA1UEAwwMMTAuMjAuMTkzLjk3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAxoL95jCHXM7ibbXP9vP77H60Qm0tkSNqDYZy\n1+ueToCJqYLHXtZXRe/kQpJmtQunQs3CRzNYWv2X29rUSqu6bjmpLHHCRANxOR6r\ng7vmybYxAKHEoUKVqjMuTduDcGXnFMR93yxX3JbNVq4jucX099b6eVtxjOIkL7aN\nbWvCXC9OOLIQVrO88Q2hRkppRvL53lldniGzwmq16CNEa0dPb+afA0mkyWd/PrTE\nim7SaTRfR9vpuk5VRzuMkxrfbYXpc6FuWPsQbsa5E9OgAc5+DKPxNw6PZfRjW4Ro\n/WKJqk33FWV4hvkoBqcTwGQuYDIeJm3tHPKJz+CVP9ekUN/I4QGy0xb+3lWLCTo8\nbA5Je+vOUmgP+zVPs7OFPhhCktg5eWAA102b/NjAnSaRxQPI2lTjKoYO4/QFkS2h\nbbYWKK4e+oAcCm3laI1Bymsjjj9vNj5+5Zr6b9e8Jdi1hjPIz0tYtcp/qDkMvPrc\n3BkQ/gDjqD6hLDFzTjdPC7FBEQX9JchGM8s5CVj5c4cZLFFMFev2VPFPrXWuIdsD\nJHVdaC0iKzb46k/qsZanYJl59DPrGV6+fIKb/wOlZDhgUFGppC81IHGQy6xRl4fw\n3nHTzdNA1d0bKmh3L/db/UU3TPhh6JCONqZM1FSclQgqYctz1fHMtUPkHGaRBIdn\nIyVnUtUCAwEAAaM+MDwwLAYDVR0RBCUwI4IIdHJpYWwwOTeCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwQKFMFhMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAEpK\nTllB9ayMiXrNguRILvWMEmCx8PjdqT8cYo5lLhlKhfsy3ejZne9qrvOR28vOFEOq\nOPXZzQQ4WG8DzN3/V5tshvOVRoyFvcBBVFDK9gcfh/2ZhSnzyorWErTY6XTuWJQu\niCleUTffMUto8MKBK73sFMvsindWCPgfhS/IH3hcC9SWd22oqeomXLx8Ue3cmJzc\nDfb3HHJ7S554UY6hKG5AbP6VE5Y0sDtlE0/cGzlPVIL2mZ0uG9PudIiYIyi26iud\n0yeNEddWQe9jyAi0zOcQ5DSgzW+mwts1A2ROPu5iDfDCK+5xRMTvNjvVS/sY1EPJ\nuGbv1gv3gVqN1f8PEdSB0/34iO0N8c8s1Qf2K+4aj+ukG0sT3O2+4X7LcAsXyreE\ns/lokoUaLoS3MwIe6h++HEsPaGnnHw6BUBnaazszMGCZfeLefVhzevn42jQkXutW\njocXwEH2mRt4+sxlRA3O56+SRU2WFFXirDZ8oBP5SdeTBseHrH50RuAiliiURnFA\nCM5LRj5eI0/attCoiORWQ/QqDS7crKm+f1z10uWKXiC663F1FSOKFMW/f+8l7okb\n4u76ByOc87EFGd9upF4IJ1yOUpaUZ5MteWhxhFKU5etIa61okVd+HL8CuA/XFg6P\nWK7lyxWnIuHvYxV4ykGjsa58dLiywijU0ZyC/Mjv\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAxoL95jCHXM7ibbXP9vP77H60Qm0tkSNqDYZy1+ueToCJqYLH\nXtZXRe/kQpJmtQunQs3CRzNYWv2X29rUSqu6bjmpLHHCRANxOR6rg7vmybYxAKHE\noUKVqjMuTduDcGXnFMR93yxX3JbNVq4jucX099b6eVtxjOIkL7aNbWvCXC9OOLIQ\nVrO88Q2hRkppRvL53lldniGzwmq16CNEa0dPb+afA0mkyWd/PrTEim7SaTRfR9vp\nuk5VRzuMkxrfbYXpc6FuWPsQbsa5E9OgAc5+DKPxNw6PZfRjW4Ro/WKJqk33FWV4\nhvkoBqcTwGQuYDIeJm3tHPKJz+CVP9ekUN/I4QGy0xb+3lWLCTo8bA5Je+vOUmgP\n+zVPs7OFPhhCktg5eWAA102b/NjAnSaRxQPI2lTjKoYO4/QFkS2hbbYWKK4e+oAc\nCm3laI1Bymsjjj9vNj5+5Zr6b9e8Jdi1hjPIz0tYtcp/qDkMvPrc3BkQ/gDjqD6h\nLDFzTjdPC7FBEQX9JchGM8s5CVj5c4cZLFFMFev2VPFPrXWuIdsDJHVdaC0iKzb4\n6k/qsZanYJl59DPrGV6+fIKb/wOlZDhgUFGppC81IHGQy6xRl4fw3nHTzdNA1d0b\nKmh3L/db/UU3TPhh6JCONqZM1FSclQgqYctz1fHMtUPkHGaRBIdnIyVnUtUCAwEA\nAQKCAgAP9IxauZDPrVM2tTPLag3YEtEDO8o7TajjAGjvoOD+90bZSIkkvr6SAPeM\nQD8gExk0/du9JEvYOGTBx4NjowzfeiP2TghqtgoeKLBpbKtekBW9MsNeoL7tyKJS\noK+eU5pwqWBilSpUsQw9CM8XSeloGC/WnDpys+Rrr1ULs+sRxL2ZQfqdNWIcz9ck\nEqwGh1X9AJrNMHFF0ZTgXSFNLBSe7l7egUdM5tQr4pSfecvQp+R2np7ZGh2xlYA1\nfKXzpB1A7Xs0jK1j8fYDOXG1Y3bvJignoDR3Yd6whuJ3ZzmgZhbTce3vj0wfyMMG\nJicyFSUmOpShzH62Jhto37i1xV7cTnC0kr8HpEG7j9nzyOR8mplkx6q2t9aWxkPa\n7TF5SQRl3Ve04+Q4/E86zbOcPHJ+LyyFcvvXOXQPvsTVTCW7Es6wia/tSJBWnKIL\n2AHs9Fe1Dw91covld5/8/b614twqgS7ZcybZhNp8RqPHEZwqWJGTHEbC7Mc457co\nhpAg6uNHOXK0wwwY3R9p3GvM+JrWVQM+l6VccYeHrPIYprF9/NfLk2rPPFegr7ik\n49/P2xONTVZa6P9kbQ9QSYvaS/TJMiJDJARvrImhudPYZHB7Dj8zyFynnmtz/PnV\n+WsERiXxLOsw10dbEYxvEg8Ly4olKN6rtL5BLLIhPiZv/PVMiwKCAQEA/KxYT/mu\n9NVF5vKGSdEBSe0AXvRtBi4OPFOhqpL7AnWM/bJ/2+HsLvAZybP7cFmmYHTonWxv\n8fEzgJLeRkkT5eGwnHTCErUFVlRyx12M5Z6GiB6ntDMQw9mqRbDl0sBSVcfbBD7D\nvMh7KT79lz0rmL3f7ih6kUBwEjxfuKd0UEORtPT0IvTRhccLmcqWANVS+j2yzLLI\n0U/9NfUuRupnUW6j1wMLveTU7Jt1W4E6Kbvpl3vb/SWb5Sqw6U+w+mS54ax8PpZp\n1dG42Y7fj7jSf4m6xVqZd7Kup19YMVKNv3eerLlMrom15j53jb/Ms3lw3L5jvbK+\nG+5xC6ryWTMw8wKCAQEAySAXUfAlkiqhWZTnpWbvRJe+/l4LsNqcs046If8UTMDX\n0Iby+8T1Gwq0vlypFYZznNHCgPsvvDpDonuK2FBWuvuvsBD9JfdY1wHs75/0Ee2V\ndJhZmmlg5i276MNHDIooxGoETZC73s1/N/1h1Fzso6+zRx9I16sYUmnfYQiju1Ql\nHGJ3lV4y9E3j1ylwEh6atfbDZAOB6qs2bvlThxzgIloPcbqxDJk3KiPM4/qinrwC\nwYSQqR69r/OTaOnMeaZNVD4ZoJEtqssW9jv61em52hTahlHt7su6CDBn+ayhCKUd\ngC8ghc9l1DugssMjdoIA0eYr1tJuskirVRCswb2fFwKCAQEA6wvT90m4dC81oJo5\nS8+umDttXeeYx+ft/DZ8LHYgJHB/oLz87enjUOKvyo+wNhpfiFkYzuDB3lpXY6K8\nPLvcU7u4FEMVClv0xBM41rbyy+PFGDkUHrBmRxpjqALgOEYKEZwh5HgSk7oXwA3F\nz3vq42K2PhDPu/Eqj/wzu02jCMtibuhzd1Uw13aLFxx6n/nR/9GHU5546yWy0g/r\nZbLGO91lci12LccCP7x51o6HMa2Jpg5lXb8vn2YwPkmQw80RkZpn1b0MZQh8IX4j\n/8mZn2TbJp2aJ9xDVpV+MBuwms1HATw61h5q5O11P5qNbONqlx5RIHV3HfqYlJcI\nbOwO+wKCAQB5Q4oL8zkT6fQiqO8KAQgeWUfk4hs2ZHi6e139hWhd5p+4sMTsHBKU\nXV4gsImZ2tj2IlqdndVoLdD9tHNAfR/t2TZSd8vKClpcOGL9D3n/HTpRdFICEatE\n3SpA6wx5eQufcTRq9+ruKQSdY36KpgRfpN348dnfft9JQWBXhvgBSHifppbnTkZ2\nmkfXQLq7kgxBzih8ssiwDs7hFh7Qhg51Z8uMDL4XFIH4PGGay1ElV8Jpn14BOfGw\nlrG4Pc71Qdm6Az88WowoQA72I6/XLfbKkGw5NEi7A8aEjXsDRJxLNBKXaNK5GxUQ\nY2s+nP1SxItuAtNH0NTBVaNHxKgEoCm9AoIBADDUgt+hZDfCrC42yIpTOMbocCi4\nJi68QNNN8mqvAQtxMxLFL4h6r76Kc5CKRN0aGbWZeODke808vwFa3Im3nBYd4qPf\n5s76pJbo50+Lbapl4JGDBy1o+uV+fDHI9LkEBAWQWP4agJ/FNo7UTBEl+jHj8wFc\nPVWcq0tcHldTvbBbGgqmLspMIAu/gsxGNw+bYmFLNkW8d+fODPtcyfNzE18ovR4S\nOUCWjdBc4LEVT3vBFylhcVnSrXzQhK8g0NL+0Khs6RlWfNs/NpL0lvymoBriDVkw\nyFvu3xaZm1ipvea4bt6/1adSuqUykteg2psmfPjBLVh1elJXO0UcZdd/oG0=\n-----END RSA PRIVATE KEY-----\n"} 2026-02-18T03:14:59.208 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-18T03:14:59.457 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-18T03:14:59.457 INFO:teuthology.orchestra.run.trial097.stdout:Creating initial admin user... 2026-02-18T03:14:59.891 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:58] ENGINE Bus STARTING 2026-02-18T03:14:59.892 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-18T03:14:59.892 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-18T03:14:59.892 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:58] ENGINE Serving on http://10.20.193.97:8765 2026-02-18T03:14:59.892 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:58] ENGINE Serving on https://10.20.193.97:7150 2026-02-18T03:14:59.892 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:58] ENGINE Bus STARTED 2026-02-18T03:14:59.892 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: [18/Feb/2026:03:14:58] ENGINE Client ('10.20.193.97', 35128) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-18T03:14:59.892 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:14:59.892 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:14:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:14:59.916 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Qr86FP7fbfdNj2pT2ykF7ObjkH6kbdDzIxUTLMXi2kyT4V1Cpimna", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771384499, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-18T03:14:59.916 INFO:teuthology.orchestra.run.trial097.stdout:Fetching dashboard port number... 2026-02-18T03:15:00.154 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stdout 8443 2026-02-18T03:15:00.163 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-18T03:15:00.163 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout disabled 2026-02-18T03:15:00.168 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-18T03:15:00.169 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout inactive 2026-02-18T03:15:00.169 INFO:teuthology.orchestra.run.trial097.stdout:firewalld.service is not enabled 2026-02-18T03:15:00.169 INFO:teuthology.orchestra.run.trial097.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-18T03:15:00.170 INFO:teuthology.orchestra.run.trial097.stdout:Ceph Dashboard is now available at: 2026-02-18T03:15:00.170 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.170 INFO:teuthology.orchestra.run.trial097.stdout: URL: https://trial097:8443/ 2026-02-18T03:15:00.170 INFO:teuthology.orchestra.run.trial097.stdout: User: admin 2026-02-18T03:15:00.170 INFO:teuthology.orchestra.run.trial097.stdout: Password: konq3nkrhu 2026-02-18T03:15:00.170 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.170 INFO:teuthology.orchestra.run.trial097.stdout:Saving cluster configuration to /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config directory 2026-02-18T03:15:00.471 INFO:teuthology.orchestra.run.trial097.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-18T03:15:00.471 INFO:teuthology.orchestra.run.trial097.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-18T03:15:00.471 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.471 INFO:teuthology.orchestra.run.trial097.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:00.471 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout:Or, if you are only running a single cluster on this host: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout: ceph telemetry on 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout:For more information see: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.472 INFO:teuthology.orchestra.run.trial097.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-18T03:15:00.473 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:00.473 INFO:teuthology.orchestra.run.trial097.stdout:Bootstrap complete. 2026-02-18T03:15:00.479 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout static 2026-02-18T03:15:00.485 INFO:teuthology.orchestra.run.trial097.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-18T03:15:00.485 INFO:teuthology.orchestra.run.trial097.stdout:systemctl: stdout inactive 2026-02-18T03:15:00.485 INFO:teuthology.orchestra.run.trial097.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-18T03:15:00.626 INFO:tasks.cephadm:Fetching config... 2026-02-18T03:15:00.627 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:15:00.627 DEBUG:teuthology.orchestra.run.trial097:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-18T03:15:00.644 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-18T03:15:00.644 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:15:00.644 DEBUG:teuthology.orchestra.run.trial097:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-18T03:15:00.681 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:00 trial097 ceph-mon[21799]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:00.681 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:00 trial097 ceph-mon[21799]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:00.681 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:00 trial097 ceph-mon[21799]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:00.681 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:00.681 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2235141321' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-18T03:15:00.681 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:00 trial097 ceph-mon[21799]: mgrmap e12: x(active, since 2s) 2026-02-18T03:15:00.681 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/378492834' entity='client.admin' 2026-02-18T03:15:00.696 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-18T03:15:00.696 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:15:00.696 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-18T03:15:00.761 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-18T03:15:00.761 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:15:00.762 DEBUG:teuthology.orchestra.run.trial097:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-18T03:15:00.818 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-18T03:15:00.819 DEBUG:teuthology.orchestra.run.trial031:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:15:00.854 INFO:teuthology.orchestra.run.trial031.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:00.864 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:15:00.899 INFO:teuthology.orchestra.run.trial078.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:00.909 DEBUG:teuthology.orchestra.run.trial097:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:15:00.940 INFO:teuthology.orchestra.run.trial097.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:00.949 DEBUG:teuthology.orchestra.run.trial114:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:15:00.985 INFO:teuthology.orchestra.run.trial114.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:00.995 DEBUG:teuthology.orchestra.run.trial119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:15:01.029 INFO:teuthology.orchestra.run.trial119.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:01.039 DEBUG:teuthology.orchestra.run.trial194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:15:01.074 INFO:teuthology.orchestra.run.trial194.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+KLIf97v/q1CjOIQLFh7EtC4IUnUcshoEXDYuf+D2+ ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:01.084 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-18T03:15:01.207 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:01.487 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-18T03:15:01.487 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-18T03:15:01.605 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:01.721 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:01 trial097 ceph-mon[21799]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:01.721 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:01.721 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:01.721 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial097", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:01.721 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:01.721 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:01.721 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:01.721 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/564339817' entity='client.admin' 2026-02-18T03:15:01.882 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial031 2026-02-18T03:15:01.882 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:15:01.882 DEBUG:teuthology.orchestra.run.trial031:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:01.901 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:15:01.901 DEBUG:teuthology.orchestra.run.trial031:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:01.958 INFO:tasks.cephadm:Adding host trial031 to orchestrator... 2026-02-18T03:15:01.958 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host add trial031 2026-02-18T03:15:02.074 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:02.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:02.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:02.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:02.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:02.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:02.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:02.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:02.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:02.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:03.882 INFO:teuthology.orchestra.run.trial097.stdout:Added host 'trial031' with addr '10.20.193.31' 2026-02-18T03:15:03.882 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:03 trial097 ceph-mon[21799]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:03.882 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:03 trial097 ceph-mon[21799]: Updating trial097:/etc/ceph/ceph.conf 2026-02-18T03:15:03.882 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:03 trial097 ceph-mon[21799]: Updating trial097:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:03.882 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:03 trial097 ceph-mon[21799]: Updating trial097:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:03.883 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:03 trial097 ceph-mon[21799]: Updating trial097:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:03.883 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:03 trial097 ceph-mon[21799]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial031", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:03.921 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:15:04.038 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:04.268 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:04.268 INFO:teuthology.orchestra.run.trial097.stdout:[{"addr": "10.20.193.97", "hostname": "trial097", "labels": [], "status": ""}, {"addr": "10.20.193.31", "hostname": "trial031", "labels": [], "status": ""}] 2026-02-18T03:15:04.306 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial078 2026-02-18T03:15:04.306 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:15:04.307 DEBUG:teuthology.orchestra.run.trial078:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:04.326 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:15:04.326 DEBUG:teuthology.orchestra.run.trial078:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:04.383 INFO:tasks.cephadm:Adding host trial078 to orchestrator... 2026-02-18T03:15:04.383 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host add trial078 2026-02-18T03:15:04.510 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:04.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:04 trial097 ceph-mon[21799]: Deploying cephadm binary to trial031 2026-02-18T03:15:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:04 trial097 ceph-mon[21799]: mgrmap e13: x(active, since 6s) 2026-02-18T03:15:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:05.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:05 trial097 ceph-mon[21799]: Added host trial031 2026-02-18T03:15:05.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:05 trial097 ceph-mon[21799]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:05.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:05 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:06.338 INFO:teuthology.orchestra.run.trial097.stdout:Added host 'trial078' with addr '10.20.193.78' 2026-02-18T03:15:06.403 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:15:06.520 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:06.635 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial078", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:06.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: Deploying cephadm binary to trial078 2026-02-18T03:15:06.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:06.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:06.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:06.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:06.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial031", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:06.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:06.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:06.637 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:06 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:06.746 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:06.746 INFO:teuthology.orchestra.run.trial097.stdout:[{"addr": "10.20.193.97", "hostname": "trial097", "labels": [], "status": ""}, {"addr": "10.20.193.31", "hostname": "trial031", "labels": [], "status": ""}, {"addr": "10.20.193.78", "hostname": "trial078", "labels": [], "status": ""}] 2026-02-18T03:15:06.783 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial114 2026-02-18T03:15:06.784 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:15:06.784 DEBUG:teuthology.orchestra.run.trial114:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:06.802 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:15:06.803 DEBUG:teuthology.orchestra.run.trial114:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:06.861 INFO:tasks.cephadm:Adding host trial114 to orchestrator... 2026-02-18T03:15:06.861 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host add trial114 2026-02-18T03:15:06.979 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:07.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: Updating trial031:/etc/ceph/ceph.conf 2026-02-18T03:15:07.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: Updating trial031:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:07.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: Updating trial031:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:07.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: Added host trial078 2026-02-18T03:15:07.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: Updating trial031:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:07.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:07.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:07.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:07.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:07.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:07.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:08.783 INFO:teuthology.orchestra.run.trial097.stdout:Added host 'trial114' with addr '10.20.193.114' 2026-02-18T03:15:08.804 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:08.804 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial114", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:08.804 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:08.804 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: Deploying cephadm binary to trial114 2026-02-18T03:15:08.804 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:08.805 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:08.805 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:08.805 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:08.805 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:08.805 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:08.805 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:08.823 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:15:08.942 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:09.176 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:09.176 INFO:teuthology.orchestra.run.trial097.stdout:[{"addr": "10.20.193.97", "hostname": "trial097", "labels": [], "status": ""}, {"addr": "10.20.193.31", "hostname": "trial031", "labels": [], "status": ""}, {"addr": "10.20.193.78", "hostname": "trial078", "labels": [], "status": ""}, {"addr": "10.20.193.114", "hostname": "trial114", "labels": [], "status": ""}] 2026-02-18T03:15:09.214 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial119 2026-02-18T03:15:09.214 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:15:09.215 DEBUG:teuthology.orchestra.run.trial119:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:09.234 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:15:09.234 DEBUG:teuthology.orchestra.run.trial119:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:09.290 INFO:tasks.cephadm:Adding host trial119 to orchestrator... 2026-02-18T03:15:09.290 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host add trial119 2026-02-18T03:15:09.406 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:09.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: Updating trial078:/etc/ceph/ceph.conf 2026-02-18T03:15:09.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: Updating trial078:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:09.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:09.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:09.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:09.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:09.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:09.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:09.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:10.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:10 trial097 ceph-mon[21799]: Updating trial078:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:10.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:10 trial097 ceph-mon[21799]: Added host trial114 2026-02-18T03:15:10.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:10 trial097 ceph-mon[21799]: Updating trial078:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:10.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:10 trial097 ceph-mon[21799]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:10.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:10 trial097 ceph-mon[21799]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial119", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:10.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:10 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.200 INFO:teuthology.orchestra.run.trial097.stdout:Added host 'trial119' with addr '10.20.193.119' 2026-02-18T03:15:11.241 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:15:11.360 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:11.589 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:11.589 INFO:teuthology.orchestra.run.trial097.stdout:[{"addr": "10.20.193.97", "hostname": "trial097", "labels": [], "status": ""}, {"addr": "10.20.193.31", "hostname": "trial031", "labels": [], "status": ""}, {"addr": "10.20.193.78", "hostname": "trial078", "labels": [], "status": ""}, {"addr": "10.20.193.114", "hostname": "trial114", "labels": [], "status": ""}, {"addr": "10.20.193.119", "hostname": "trial119", "labels": [], "status": ""}] 2026-02-18T03:15:11.659 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial194 2026-02-18T03:15:11.660 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:15:11.660 DEBUG:teuthology.orchestra.run.trial194:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:11.678 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:15:11.678 DEBUG:teuthology.orchestra.run.trial194:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:11.735 INFO:tasks.cephadm:Adding host trial194 to orchestrator... 2026-02-18T03:15:11.735 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host add trial194 2026-02-18T03:15:11.756 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: Deploying cephadm binary to trial119 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial114", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:11.757 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:11.853 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:12.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: Updating trial114:/etc/ceph/ceph.conf 2026-02-18T03:15:12.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: Updating trial114:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:12.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: Updating trial114:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:12.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: Added host trial119 2026-02-18T03:15:12.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: Updating trial114:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:12.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:12.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:12.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:12.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:12 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:13.633 INFO:teuthology.orchestra.run.trial097.stdout:Added host 'trial194' with addr '10.20.193.194' 2026-02-18T03:15:13.671 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:15:13.828 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:13.850 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial194", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:13.850 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: Deploying cephadm binary to trial194 2026-02-18T03:15:13.851 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:13.851 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:13.851 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:13.851 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:13.851 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial119", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:13.851 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:13.851 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:13 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:14.059 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:14.059 INFO:teuthology.orchestra.run.trial097.stdout:[{"addr": "10.20.193.97", "hostname": "trial097", "labels": [], "status": ""}, {"addr": "10.20.193.31", "hostname": "trial031", "labels": [], "status": ""}, {"addr": "10.20.193.78", "hostname": "trial078", "labels": [], "status": ""}, {"addr": "10.20.193.114", "hostname": "trial114", "labels": [], "status": ""}, {"addr": "10.20.193.119", "hostname": "trial119", "labels": [], "status": ""}, {"addr": "10.20.193.194", "hostname": "trial194", "labels": [], "status": ""}] 2026-02-18T03:15:14.096 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-18T03:15:14.096 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd crush tunables default 2026-02-18T03:15:14.214 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:14.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: Updating trial119:/etc/ceph/ceph.conf 2026-02-18T03:15:14.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: Updating trial119:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: Updating trial119:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: Added host trial194 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: Updating trial119:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/549187244' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-18T03:15:15.190 INFO:teuthology.orchestra.run.trial097.stderr:adjusted tunables profile to default 2026-02-18T03:15:15.230 INFO:tasks.cephadm:Adding mon.a on trial097 2026-02-18T03:15:15.230 INFO:tasks.cephadm:Adding mon.b on trial114 2026-02-18T03:15:15.230 INFO:tasks.cephadm:Adding mon.c on trial119 2026-02-18T03:15:15.230 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch apply mon '3;trial097:10.20.193.97=a;trial114:10.20.193.114=b;trial119:10.20.193.119=c' 2026-02-18T03:15:15.350 INFO:teuthology.orchestra.run.trial194.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-18T03:15:15.350 INFO:teuthology.orchestra.run.trial194.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-18T03:15:15.591 INFO:teuthology.orchestra.run.trial194.stdout:Scheduled mon update... 2026-02-18T03:15:15.631 DEBUG:teuthology.orchestra.run.trial114:mon.b> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.b.service 2026-02-18T03:15:15.633 DEBUG:teuthology.orchestra.run.trial119:mon.c> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.c.service 2026-02-18T03:15:15.637 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-18T03:15:15.637 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph mon dump -f json 2026-02-18T03:15:15.795 INFO:teuthology.orchestra.run.trial119.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:15.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='client.14198 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:15.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:15.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/549187244' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-18T03:15:15.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:15:15.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:15.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:15.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:15.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:15.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial194", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:15.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:15.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:15.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:15 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:16.062 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:15:16.062 INFO:teuthology.orchestra.run.trial119.stdout:{"epoch":1,"fsid":"eb431a19-0c77-11f1-b2a8-d404e6e7d460","modified":"2026-02-18T03:14:36.832353Z","created":"2026-02-18T03:14:36.832353Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:3300","nonce":0},{"type":"v1","addr":"10.20.193.97:6789","nonce":0}]},"addr":"10.20.193.97:6789/0","public_addr":"10.20.193.97:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-18T03:15:16.062 INFO:teuthology.orchestra.run.trial119.stderr:dumped monmap epoch 1 2026-02-18T03:15:16.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: Updating trial194:/etc/ceph/ceph.conf 2026-02-18T03:15:16.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial097:10.20.193.97=a;trial114:10.20.193.114=b;trial119:10.20.193.119=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:16.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: Saving service mon spec with placement trial097:10.20.193.97=a;trial114:10.20.193.114=b;trial119:10.20.193.119=c;count:3 2026-02-18T03:15:16.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2331309154' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:15:16.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:16.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:16.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:16.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:16.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:16 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:17.103 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-18T03:15:17.103 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph mon dump -f json 2026-02-18T03:15:17.239 INFO:teuthology.orchestra.run.trial119.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.c/config 2026-02-18T03:15:18.500 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 systemd[1]: Started Ceph mon.b for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:15:18.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:15:18.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:15:18.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: pidfile_write: ignore empty --pid-file 2026-02-18T03:15:18.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: load: jerasure load: lrc 2026-02-18T03:15:18.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Git sha 0 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: DB SUMMARY 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: DB Session ID: 7KS7G4L65ZCWOVJJJ5DQ 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2026-02-18T03:15:18.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.env: 0x5634f420a100 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.info_log: 0x5634f9ceae80 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:15:18.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.statistics: (nil) 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.use_fsync: 0 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:15:18.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.db_log_dir: 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.wal_dir: 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:15:18.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.write_buffer_manager: 0x5634f9cee500 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:15:18.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.unordered_write: 0 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.row_cache: None 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.wal_filter: None 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:15:18.981 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.wal_compression: 0 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:15:18.982 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:15:18.983 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:15:18.986 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:15:18.986 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:15:18.986 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:15:18.986 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:15:18.986 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:15:18.986 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:15:18.986 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:15:18.986 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_open_files: -1 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:15:18.987 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Compression algorithms supported: 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: kZSTD supported: 0 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:15:18.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.merge_operator: 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_filter: None 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5634f9cea3c0) 2026-02-18T03:15:18.989 INFO:journalctl@ceph.mon.b.trial114.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: index_type: 0 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: data_block_index_type: 0 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: index_shortening: 1 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: checksum: 4 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: no_block_cache: 0 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: block_cache: 0x5634f9d0bb90 2026-02-18T03:15:18.990 INFO:journalctl@ceph.mon.b.trial114.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: block_cache_options: 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: capacity : 536870912 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: num_shard_bits : 4 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: strict_capacity_limit : 0 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: block_cache_compressed: (nil) 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: persistent_cache: (nil) 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: block_size: 4096 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: block_size_deviation: 10 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: block_restart_interval: 16 2026-02-18T03:15:18.991 INFO:journalctl@ceph.mon.b.trial114.stdout: index_block_restart_interval: 1 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: metadata_block_size: 4096 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: partition_filters: 0 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: use_delta_encoding: 1 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: filter_policy: bloomfilter 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: whole_key_filtering: 1 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: verify_compression: 0 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: format_version: 5 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: enable_index_compression: 1 2026-02-18T03:15:18.992 INFO:journalctl@ceph.mon.b.trial114.stdout: block_align: 0 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout: max_auto_readahead_size: 262144 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout: prepopulate_block_cache: 0 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression: NoCompression 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:15:18.993 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.num_levels: 7 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:15:18.994 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:15:18.995 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:15:18.996 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:15:18.997 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:15:18.998 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:15:18.999 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.ttl: 2592000 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:15:19.000 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e6b65ecc-7344-4ea9-9a41-8e25eac1a593 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771384518502367, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771384518502729, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1647, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771384518, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e6b65ecc-7344-4ea9-9a41-8e25eac1a593", "db_session_id": "7KS7G4L65ZCWOVJJJ5DQ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:15:19.001 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771384518502782, "job": 1, "event": "recovery_finished"} 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5634f9d0e700 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: DB pointer 0x5634f9d20000 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout: ** DB Stats ** 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:15:19.002 INFO:journalctl@ceph.mon.b.trial114.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: ** Compaction Stats [default] ** 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-18T03:15:19.003 INFO:journalctl@ceph.mon.b.trial114.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: ** Compaction Stats [default] ** 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:15:19.004 INFO:journalctl@ceph.mon.b.trial114.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: Block cache BinnedLRUCache@0x5634f9d0bb90#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-02-18T03:15:19.005 INFO:journalctl@ceph.mon.b.trial114.stdout: 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b does not exist in monmap, will attempt to join an existing cluster 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: using public_addr v2:10.20.193.114:0/0 -> [v2:10.20.193.114:3300/0,v1:10.20.193.114:6789/0] 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: starting mon.b rank -1 at public addrs [v2:10.20.193.114:3300/0,v1:10.20.193.114:6789/0] at bind addrs [v2:10.20.193.114:3300/0,v1:10.20.193.114:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(???) e0 preinit fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).mds e1 new map 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).mds e1 print_map 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout: e1 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout: btime 2026-02-18T03:14:37:769894+0000 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:15:19.006 INFO:journalctl@ceph.mon.b.trial114.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout: legacy client fscid: -1 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout: 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout: No filesystems configured 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2026-02-18T03:15:19.007 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mkfs eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: monmap epoch 1 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: last_changed 2026-02-18T03:14:36.832353+0000 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: created 2026-02-18T03:14:36.832353+0000 2026-02-18T03:15:19.008 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: min_mon_release 20 (tentacle) 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: election_strategy: 1 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: 0: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.a 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: fsmap 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: osdmap e1: 0 total, 0 up, 0 in 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e1: no daemons active 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2297050810' entity='client.admin' 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3331177654' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1818865884' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Activating manager daemon x 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e2: x(active, starting, since 0.00314488s) 2026-02-18T03:15:19.009 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Manager daemon x is now available 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' 2026-02-18T03:15:19.010 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14100 10.20.193.97:0/954076988' entity='mgr.x' 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e3: x(active, since 1.00583s) 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/106808990' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e4: x(active, since 2s) 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2149291516' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3767280762' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3767280762' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e5: x(active, since 3s) 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2040890107' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Active manager daemon x restarted 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Activating manager daemon x 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: osdmap e2: 0 total, 0 up, 0 in 2026-02-18T03:15:19.011 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e6: x(active, starting, since 0.00332489s) 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Manager daemon x is now available 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Found migration_current of "None". Setting to last migration. 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.012 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e7: x(active, since 1.00396s) 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2621589165' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:49] ENGINE Bus STARTING 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:49] ENGINE Serving on http://10.20.193.97:8765 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:49] ENGINE Serving on https://10.20.193.97:7150 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:49] ENGINE Bus STARTED 2026-02-18T03:15:19.013 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:49] ENGINE Client ('10.20.193.97', 35230) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2621589165' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e8: x(active, since 2s) 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Generating ssh key... 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.014 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial097", "addr": "10.20.193.97", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Deploying cephadm binary to trial097 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Added host trial097 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Saving service mon spec with placement count:5 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/409575707' entity='client.admin' 2026-02-18T03:15:19.015 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Saving service mgr spec with placement count:2 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/208858833' entity='client.admin' 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2502131834' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14118 10.20.193.97:0/2254803062' entity='mgr.x' 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2502131834' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e9: x(active, since 6s) 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1267453173' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Active manager daemon x restarted 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Activating manager daemon x 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: osdmap e3: 0 total, 0 up, 0 in 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e10: x(active, starting, since 0.00349075s) 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:15:19.016 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Manager daemon x is now available 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e11: x(active, since 1.00557s) 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:58] ENGINE Bus STARTING 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-18T03:15:19.017 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:58] ENGINE Serving on http://10.20.193.97:8765 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:58] ENGINE Serving on https://10.20.193.97:7150 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:58] ENGINE Bus STARTED 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: [18/Feb/2026:03:14:58] ENGINE Client ('10.20.193.97', 35128) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2235141321' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e12: x(active, since 2s) 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/378492834' entity='client.admin' 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.018 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial097", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/564339817' entity='client.admin' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.019 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial097:/etc/ceph/ceph.conf 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial097:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial097:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial097:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial031", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Deploying cephadm binary to trial031 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mgrmap e13: x(active, since 6s) 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Added host trial031 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:19.020 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial078", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Deploying cephadm binary to trial078 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial031", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial031:/etc/ceph/ceph.conf 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial031:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial031:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Added host trial078 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial031:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.021 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial114", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Deploying cephadm binary to trial114 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:19.022 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial078:/etc/ceph/ceph.conf 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial078:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial078:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Added host trial114 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial078:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial119", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Deploying cephadm binary to trial119 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial114", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial114:/etc/ceph/ceph.conf 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial114:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial114:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Added host trial119 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial114:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:19.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial194", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Deploying cephadm binary to trial194 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial119", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial119:/etc/ceph/ceph.conf 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial119:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial119:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Added host trial194 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial119:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.025 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/549187244' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14198 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/549187244' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial194", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Updating trial194:/etc/ceph/ceph.conf 2026-02-18T03:15:19.026 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial097:10.20.193.97=a;trial114:10.20.193.114=b;trial119:10.20.193.119=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:19.027 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: Saving service mon spec with placement trial097:10.20.193.97=a;trial114:10.20.193.114=b;trial119:10.20.193.119=c;count:3 2026-02-18T03:15:19.027 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2331309154' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:15:19.027 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.027 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.027 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:19.027 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:19.027 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:19.027 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:18 trial114 ceph-mon[23907]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-18T03:15:22.630 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:22 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:22.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: Deploying daemon mon.b on trial114 2026-02-18T03:15:22.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:15:22.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: mon.a calling monitor election 2026-02-18T03:15:22.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:22.653 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: mon.c calling monitor election 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:22.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: monmap epoch 2 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: last_changed 2026-02-18T03:15:17.300009+0000 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: created 2026-02-18T03:14:36.832353+0000 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: min_mon_release 20 (tentacle) 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: election_strategy: 1 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: 0: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.a 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: 1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.c 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: fsmap 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:15:22.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: mgrmap e13: x(active, since 24s) 2026-02-18T03:15:22.656 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: overall HEALTH_OK 2026-02-18T03:15:22.656 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:22.656 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:22.656 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:22.656 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:22 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:23.653 INFO:journalctl@ceph.mgr.x.trial097.stdout:Feb 18 03:15:23 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mgr-x[22052]: 2026-02-18T03:15:23.300+0000 7f429caab640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: mon.c calling monitor election 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: mon.a calling monitor election 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: mon.b calling monitor election 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: monmap epoch 3 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: last_changed 2026-02-18T03:15:22.524938+0000 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: created 2026-02-18T03:14:36.832353+0000 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: min_mon_release 20 (tentacle) 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: election_strategy: 1 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: 0: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.a 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: 1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.c 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: 2: [v2:10.20.193.114:3300/0,v1:10.20.193.114:6789/0] mon.b 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: fsmap 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: mgrmap e13: x(active, since 30s) 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: overall HEALTH_OK 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:27.915 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:15:27.916 INFO:teuthology.orchestra.run.trial119.stdout:{"epoch":3,"fsid":"eb431a19-0c77-11f1-b2a8-d404e6e7d460","modified":"2026-02-18T03:15:22.524938Z","created":"2026-02-18T03:14:36.832353Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:3300","nonce":0},{"type":"v1","addr":"10.20.193.97:6789","nonce":0}]},"addr":"10.20.193.97:6789/0","public_addr":"10.20.193.97:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:3300","nonce":0},{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:3300","nonce":0},{"type":"v1","addr":"10.20.193.114:6789","nonce":0}]},"addr":"10.20.193.114:6789/0","public_addr":"10.20.193.114:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2026-02-18T03:15:27.916 INFO:teuthology.orchestra.run.trial119.stderr:dumped monmap epoch 3 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: mon.c calling monitor election 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: mon.a calling monitor election 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: mon.b calling monitor election 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:15:27.916 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: monmap epoch 3 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: last_changed 2026-02-18T03:15:22.524938+0000 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: created 2026-02-18T03:14:36.832353+0000 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: min_mon_release 20 (tentacle) 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: election_strategy: 1 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: 0: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.a 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: 1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.c 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: 2: [v2:10.20.193.114:3300/0,v1:10.20.193.114:6789/0] mon.b 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: fsmap 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: mgrmap e13: x(active, since 30s) 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: overall HEALTH_OK 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:27.917 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:27.953 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-18T03:15:27.953 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-18T03:15:27.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: Deploying daemon mon.b on trial114 2026-02-18T03:15:27.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mon.a calling monitor election 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mon.c calling monitor election 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: monmap epoch 2 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: last_changed 2026-02-18T03:15:17.300009+0000 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: created 2026-02-18T03:14:36.832353+0000 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: min_mon_release 20 (tentacle) 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: election_strategy: 1 2026-02-18T03:15:27.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: 0: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.a 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: 1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.c 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: fsmap 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mgrmap e13: x(active, since 24s) 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: overall HEALTH_OK 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mon.c calling monitor election 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mon.a calling monitor election 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mon.b calling monitor election 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: monmap epoch 3 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:27.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: last_changed 2026-02-18T03:15:22.524938+0000 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: created 2026-02-18T03:14:36.832353+0000 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: min_mon_release 20 (tentacle) 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: election_strategy: 1 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: 0: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.a 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: 1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.c 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: 2: [v2:10.20.193.114:3300/0,v1:10.20.193.114:6789/0] mon.b 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: fsmap 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: mgrmap e13: x(active, since 30s) 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: overall HEALTH_OK 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.979 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:27.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:27.980 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:28.067 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:28.293 INFO:teuthology.orchestra.run.trial097.stdout:# minimal ceph.conf for eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:28.293 INFO:teuthology.orchestra.run.trial097.stdout:[global] 2026-02-18T03:15:28.293 INFO:teuthology.orchestra.run.trial097.stdout: fsid = eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:15:28.294 INFO:teuthology.orchestra.run.trial097.stdout: mon_host = [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] [v2:10.20.193.114:3300/0,v1:10.20.193.114:6789/0] [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-18T03:15:28.331 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-18T03:15:28.331 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:15:28.331 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:28.360 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:15:28.360 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:28.423 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:15:28.424 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:28.453 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:15:28.453 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:28.517 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:15:28.517 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:28.543 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:15:28.543 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:28.608 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:15:28.609 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:28.637 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:15:28.637 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:28.701 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:15:28.701 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:28.728 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:15:28.728 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:28.793 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:15:28.793 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:15:28.820 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:15:28.820 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:15:28.884 INFO:tasks.cephadm:Adding mgr.x on trial097 2026-02-18T03:15:28.885 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch apply mgr '1;trial097=x' 2026-02-18T03:15:28.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:28.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: Updating trial097:/etc/ceph/ceph.conf 2026-02-18T03:15:28.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: Updating trial031:/etc/ceph/ceph.conf 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: Updating trial078:/etc/ceph/ceph.conf 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: Updating trial114:/etc/ceph/ceph.conf 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: Updating trial119:/etc/ceph/ceph.conf 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: Updating trial194:/etc/ceph/ceph.conf 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: Updating trial097:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1640628560' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/180195571' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:28 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: Updating trial097:/etc/ceph/ceph.conf 2026-02-18T03:15:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: Updating trial031:/etc/ceph/ceph.conf 2026-02-18T03:15:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: Updating trial078:/etc/ceph/ceph.conf 2026-02-18T03:15:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: Updating trial114:/etc/ceph/ceph.conf 2026-02-18T03:15:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: Updating trial119:/etc/ceph/ceph.conf 2026-02-18T03:15:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: Updating trial194:/etc/ceph/ceph.conf 2026-02-18T03:15:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: Updating trial097:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1640628560' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/180195571' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.967 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.967 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.967 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.967 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.967 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.967 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:28 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: Updating trial097:/etc/ceph/ceph.conf 2026-02-18T03:15:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: Updating trial031:/etc/ceph/ceph.conf 2026-02-18T03:15:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: Updating trial078:/etc/ceph/ceph.conf 2026-02-18T03:15:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: Updating trial114:/etc/ceph/ceph.conf 2026-02-18T03:15:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: Updating trial119:/etc/ceph/ceph.conf 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: Updating trial194:/etc/ceph/ceph.conf 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: Updating trial097:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1640628560' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/180195571' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:28.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:15:28.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:15:28.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:28.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:28 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:15:29.045 INFO:teuthology.orchestra.run.trial194.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.287 INFO:teuthology.orchestra.run.trial194.stdout:Scheduled mgr update... 2026-02-18T03:15:29.327 DEBUG:tasks.cephadm:set 0 configs 2026-02-18T03:15:29.327 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph config dump 2026-02-18T03:15:29.442 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:29.672 INFO:teuthology.orchestra.run.trial097.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global dev auth_debug true 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c * 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global dev debug_asserts_on_shutdown true 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global basic log_to_file true 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global basic log_to_journald false 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global basic log_to_stderr false 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_allow_pool_delete true 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_cluster_log_to_file true 2026-02-18T03:15:29.673 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global dev mon_warn_on_pool_no_app false 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global dev ms_die_on_bug true 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global dev ms_die_on_old_message true 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-18T03:15:29.674 INFO:teuthology.orchestra.run.trial097.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced debug_mon 20/20 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced debug_ms 1/1 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced debug_paxos 20/20 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced mon_data_avail_warn 5 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-18T03:15:29.675 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced debug_mgr 20/20 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced debug_ms 1/1 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-18T03:15:29.676 INFO:teuthology.orchestra.run.trial097.stdout:osd dev bdev_debug_aio true 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced debug_ms 1/1 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced debug_osd 20/20 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd dev osd_debug_misdirected_ops true 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd dev osd_debug_op_order true 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd dev osd_debug_shutdown true 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-18T03:15:29.677 INFO:teuthology.orchestra.run.trial097.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_memory_target_autotune true 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_op_queue debug_random * 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_recover_clone_overlap true 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-18T03:15:29.678 INFO:teuthology.orchestra.run.trial097.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-18T03:15:29.711 INFO:tasks.cephadm:Deploying OSDs... 2026-02-18T03:15:29.711 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:15:29.711 DEBUG:teuthology.orchestra.run.trial031:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:15:29.729 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:15:29.730 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_1 2026-02-18T03:15:29.786 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:15:29.786 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:29.787 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1581 Links: 1 2026-02-18T03:15:29.787 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:29.787 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:29.787 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-18 03:15:05.612559238 +0000 2026-02-18T03:15:29.787 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-18 03:14:11.498579936 +0000 2026-02-18T03:15:29.787 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-18 03:14:11.498579936 +0000 2026-02-18T03:15:29.787 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-18 03:14:11.498579936 +0000 2026-02-18T03:15:29.787 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:15:29.849 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-18T03:15:29.850 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-18T03:15:29.850 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000151872 s, 3.4 MB/s 2026-02-18T03:15:29.851 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:15:29.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Updating trial114:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Updating trial031:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Updating trial194:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Updating trial078:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Updating trial119:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Reconfiguring mon.a (unknown last config time)... 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Reconfiguring daemon mon.a on trial097 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Reconfiguring mon.b (monmap changed)... 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Reconfiguring daemon mon.b on trial114 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Reconfiguring mon.c (monmap changed)... 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: Reconfiguring daemon mon.c on trial119 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-18T03:15:29.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:29 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:29.909 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_2 2026-02-18T03:15:29.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Updating trial114:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Updating trial031:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Updating trial194:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Updating trial078:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Updating trial119:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Reconfiguring mon.a (unknown last config time)... 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Reconfiguring daemon mon.a on trial097 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Reconfiguring mon.b (monmap changed)... 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Reconfiguring daemon mon.b on trial114 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Reconfiguring mon.c (monmap changed)... 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: Reconfiguring daemon mon.c on trial119 2026-02-18T03:15:29.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-18T03:15:29.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-18T03:15:29.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:29 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:29.967 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:15:29.967 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:29.967 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1591 Links: 1 2026-02-18T03:15:29.967 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:29.967 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:29.967 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-18 03:15:05.612559238 +0000 2026-02-18T03:15:29.968 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-18 03:14:11.499579917 +0000 2026-02-18T03:15:29.968 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-18 03:14:11.499579917 +0000 2026-02-18T03:15:29.968 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-18 03:14:11.499579917 +0000 2026-02-18T03:15:29.968 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:15:29.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Updating trial114:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Updating trial031:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Updating trial194:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Updating trial078:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Updating trial119:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:29.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Reconfiguring mon.a (unknown last config time)... 2026-02-18T03:15:29.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Reconfiguring daemon mon.a on trial097 2026-02-18T03:15:29.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Reconfiguring mon.b (monmap changed)... 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Reconfiguring daemon mon.b on trial114 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Reconfiguring mon.c (monmap changed)... 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: Reconfiguring daemon mon.c on trial119 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:29.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:29.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:29.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:29.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-18T03:15:29.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-18T03:15:29.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:29 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:30.030 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-18T03:15:30.030 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-18T03:15:30.030 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.00015603 s, 3.3 MB/s 2026-02-18T03:15:30.032 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:15:30.088 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_3 2026-02-18T03:15:30.144 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:15:30.144 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:30.145 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1595 Links: 1 2026-02-18T03:15:30.145 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:30.145 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:30.145 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-18 03:15:05.612559238 +0000 2026-02-18T03:15:30.145 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-18 03:14:11.499579917 +0000 2026-02-18T03:15:30.145 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-18 03:14:11.499579917 +0000 2026-02-18T03:15:30.145 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-18 03:14:11.499579917 +0000 2026-02-18T03:15:30.145 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:15:30.208 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-18T03:15:30.208 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-18T03:15:30.208 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000217724 s, 2.4 MB/s 2026-02-18T03:15:30.209 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:15:30.266 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_4 2026-02-18T03:15:30.322 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:15:30.323 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:30.323 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1603 Links: 1 2026-02-18T03:15:30.323 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:30.323 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:30.323 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-18 03:15:05.612559238 +0000 2026-02-18T03:15:30.323 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-18 03:14:11.500579899 +0000 2026-02-18T03:15:30.323 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-18 03:14:11.500579899 +0000 2026-02-18T03:15:30.323 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-18 03:14:11.500579899 +0000 2026-02-18T03:15:30.324 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:15:30.387 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-18T03:15:30.387 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-18T03:15:30.387 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000209289 s, 2.4 MB/s 2026-02-18T03:15:30.389 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:15:30.447 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:15:30.447 DEBUG:teuthology.orchestra.run.trial078:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:15:30.466 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:15:30.466 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_1 2026-02-18T03:15:30.521 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:15:30.522 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:30.522 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1598 Links: 1 2026-02-18T03:15:30.522 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:30.522 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:30.522 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-18 03:15:08.074595075 +0000 2026-02-18T03:15:30.522 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-18 03:14:03.149845079 +0000 2026-02-18T03:15:30.522 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-18 03:14:03.149845079 +0000 2026-02-18T03:15:30.522 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-18 03:14:03.149845079 +0000 2026-02-18T03:15:30.523 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:15:30.585 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-18T03:15:30.586 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-18T03:15:30.586 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000157312 s, 3.3 MB/s 2026-02-18T03:15:30.587 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:15:30.644 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_2 2026-02-18T03:15:30.699 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:15:30.699 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:30.699 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1595 Links: 1 2026-02-18T03:15:30.699 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:30.700 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:30.700 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-18 03:15:08.074595075 +0000 2026-02-18T03:15:30.700 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-18 03:14:03.149845079 +0000 2026-02-18T03:15:30.700 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-18 03:14:03.149845079 +0000 2026-02-18T03:15:30.700 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-18 03:14:03.149845079 +0000 2026-02-18T03:15:30.700 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:15:30.763 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-18T03:15:30.763 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-18T03:15:30.763 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000131093 s, 3.9 MB/s 2026-02-18T03:15:30.764 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:15:30.821 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_3 2026-02-18T03:15:30.877 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:15:30.877 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:30.877 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1602 Links: 1 2026-02-18T03:15:30.877 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:30.877 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:30.878 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-18 03:15:08.074595075 +0000 2026-02-18T03:15:30.878 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-18 03:14:03.150845054 +0000 2026-02-18T03:15:30.878 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-18 03:14:03.150845054 +0000 2026-02-18T03:15:30.878 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-18 03:14:03.150845054 +0000 2026-02-18T03:15:30.878 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:15:30.939 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-18T03:15:30.940 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-18T03:15:30.940 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000167211 s, 3.1 MB/s 2026-02-18T03:15:30.941 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:15:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:30 trial119 ceph-mon[24143]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial097=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:30 trial119 ceph-mon[24143]: Saving service mgr spec with placement trial097=x;count:1 2026-02-18T03:15:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:30 trial119 ceph-mon[24143]: Reconfiguring mgr.x (unknown last config time)... 2026-02-18T03:15:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:30 trial119 ceph-mon[24143]: Reconfiguring daemon mgr.x on trial097 2026-02-18T03:15:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:30 trial119 ceph-mon[24143]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:30 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:30 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3979430847' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-18T03:15:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:30 trial114 ceph-mon[23907]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial097=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:30 trial114 ceph-mon[23907]: Saving service mgr spec with placement trial097=x;count:1 2026-02-18T03:15:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:30 trial114 ceph-mon[23907]: Reconfiguring mgr.x (unknown last config time)... 2026-02-18T03:15:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:30 trial114 ceph-mon[23907]: Reconfiguring daemon mgr.x on trial097 2026-02-18T03:15:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:30 trial114 ceph-mon[23907]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:30 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:30 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3979430847' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-18T03:15:30.998 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_4 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1610 Links: 1 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-18 03:15:08.074595075 +0000 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-18 03:14:03.151845030 +0000 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-18 03:14:03.151845030 +0000 2026-02-18T03:15:31.056 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-18 03:14:03.151845030 +0000 2026-02-18T03:15:31.056 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:15:31.118 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-18T03:15:31.118 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-18T03:15:31.118 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000146703 s, 3.5 MB/s 2026-02-18T03:15:31.119 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:15:31.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:30 trial097 ceph-mon[21799]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial097=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:31.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:30 trial097 ceph-mon[21799]: Saving service mgr spec with placement trial097=x;count:1 2026-02-18T03:15:31.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:30 trial097 ceph-mon[21799]: Reconfiguring mgr.x (unknown last config time)... 2026-02-18T03:15:31.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:30 trial097 ceph-mon[21799]: Reconfiguring daemon mgr.x on trial097 2026-02-18T03:15:31.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:30 trial097 ceph-mon[21799]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:31.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:30 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:31.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:30 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:31.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3979430847' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-18T03:15:31.177 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:15:31.177 DEBUG:teuthology.orchestra.run.trial097:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:15:31.196 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:15:31.197 DEBUG:teuthology.orchestra.run.trial097:> stat /dev/vg_nvme/lv_1 2026-02-18T03:15:31.254 INFO:teuthology.orchestra.run.trial097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:15:31.254 INFO:teuthology.orchestra.run.trial097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:31.254 INFO:teuthology.orchestra.run.trial097.stdout:Device: 6h/6d Inode: 1588 Links: 1 2026-02-18T03:15:31.255 INFO:teuthology.orchestra.run.trial097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:31.255 INFO:teuthology.orchestra.run.trial097.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:31.255 INFO:teuthology.orchestra.run.trial097.stdout:Access: 2026-02-18 03:15:01.454715965 +0000 2026-02-18T03:15:31.255 INFO:teuthology.orchestra.run.trial097.stdout:Modify: 2026-02-18 03:13:57.267299706 +0000 2026-02-18T03:15:31.255 INFO:teuthology.orchestra.run.trial097.stdout:Change: 2026-02-18 03:13:57.267299706 +0000 2026-02-18T03:15:31.255 INFO:teuthology.orchestra.run.trial097.stdout: Birth: 2026-02-18 03:13:57.267299706 +0000 2026-02-18T03:15:31.255 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:15:31.318 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records in 2026-02-18T03:15:31.318 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records out 2026-02-18T03:15:31.318 INFO:teuthology.orchestra.run.trial097.stderr:512 bytes copied, 0.000172919 s, 3.0 MB/s 2026-02-18T03:15:31.320 DEBUG:teuthology.orchestra.run.trial097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:15:31.376 DEBUG:teuthology.orchestra.run.trial097:> stat /dev/vg_nvme/lv_2 2026-02-18T03:15:31.432 INFO:teuthology.orchestra.run.trial097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:15:31.433 INFO:teuthology.orchestra.run.trial097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:31.433 INFO:teuthology.orchestra.run.trial097.stdout:Device: 6h/6d Inode: 1582 Links: 1 2026-02-18T03:15:31.433 INFO:teuthology.orchestra.run.trial097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:31.433 INFO:teuthology.orchestra.run.trial097.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:31.433 INFO:teuthology.orchestra.run.trial097.stdout:Access: 2026-02-18 03:15:01.454715965 +0000 2026-02-18T03:15:31.433 INFO:teuthology.orchestra.run.trial097.stdout:Modify: 2026-02-18 03:13:57.266299725 +0000 2026-02-18T03:15:31.433 INFO:teuthology.orchestra.run.trial097.stdout:Change: 2026-02-18 03:13:57.266299725 +0000 2026-02-18T03:15:31.433 INFO:teuthology.orchestra.run.trial097.stdout: Birth: 2026-02-18 03:13:57.266299725 +0000 2026-02-18T03:15:31.434 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:15:31.496 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records in 2026-02-18T03:15:31.496 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records out 2026-02-18T03:15:31.496 INFO:teuthology.orchestra.run.trial097.stderr:512 bytes copied, 0.000166838 s, 3.1 MB/s 2026-02-18T03:15:31.498 DEBUG:teuthology.orchestra.run.trial097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:15:31.555 DEBUG:teuthology.orchestra.run.trial097:> stat /dev/vg_nvme/lv_3 2026-02-18T03:15:31.612 INFO:teuthology.orchestra.run.trial097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:15:31.613 INFO:teuthology.orchestra.run.trial097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:31.613 INFO:teuthology.orchestra.run.trial097.stdout:Device: 6h/6d Inode: 1600 Links: 1 2026-02-18T03:15:31.613 INFO:teuthology.orchestra.run.trial097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:31.613 INFO:teuthology.orchestra.run.trial097.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:31.613 INFO:teuthology.orchestra.run.trial097.stdout:Access: 2026-02-18 03:15:01.454715965 +0000 2026-02-18T03:15:31.613 INFO:teuthology.orchestra.run.trial097.stdout:Modify: 2026-02-18 03:13:57.268299688 +0000 2026-02-18T03:15:31.613 INFO:teuthology.orchestra.run.trial097.stdout:Change: 2026-02-18 03:13:57.268299688 +0000 2026-02-18T03:15:31.613 INFO:teuthology.orchestra.run.trial097.stdout: Birth: 2026-02-18 03:13:57.268299688 +0000 2026-02-18T03:15:31.614 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:15:31.677 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records in 2026-02-18T03:15:31.677 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records out 2026-02-18T03:15:31.677 INFO:teuthology.orchestra.run.trial097.stderr:512 bytes copied, 0.000166437 s, 3.1 MB/s 2026-02-18T03:15:31.678 DEBUG:teuthology.orchestra.run.trial097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:15:31.735 DEBUG:teuthology.orchestra.run.trial097:> stat /dev/vg_nvme/lv_4 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout:Device: 6h/6d Inode: 1594 Links: 1 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout:Access: 2026-02-18 03:15:01.454715965 +0000 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout:Modify: 2026-02-18 03:13:57.268299688 +0000 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout:Change: 2026-02-18 03:13:57.268299688 +0000 2026-02-18T03:15:31.792 INFO:teuthology.orchestra.run.trial097.stdout: Birth: 2026-02-18 03:13:57.268299688 +0000 2026-02-18T03:15:31.793 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:15:31.856 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records in 2026-02-18T03:15:31.856 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records out 2026-02-18T03:15:31.856 INFO:teuthology.orchestra.run.trial097.stderr:512 bytes copied, 0.000147782 s, 3.5 MB/s 2026-02-18T03:15:31.857 DEBUG:teuthology.orchestra.run.trial097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:15:31.923 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:15:31.924 DEBUG:teuthology.orchestra.run.trial114:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:15:31.945 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:15:31.945 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_1 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 1609 Links: 1 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-18 03:15:18.286264780 +0000 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-18 03:14:03.772808772 +0000 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-18 03:14:03.772808772 +0000 2026-02-18T03:15:32.002 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-18 03:14:03.772808772 +0000 2026-02-18T03:15:32.002 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:15:32.066 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-18T03:15:32.066 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-18T03:15:32.066 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000144663 s, 3.5 MB/s 2026-02-18T03:15:32.067 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:15:32.123 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_2 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 1590 Links: 1 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-18 03:15:18.286264780 +0000 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.178 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.178 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:15:32.240 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-18T03:15:32.240 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-18T03:15:32.240 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000151005 s, 3.4 MB/s 2026-02-18T03:15:32.241 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:15:32.297 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_3 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 1588 Links: 1 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-18 03:15:18.287264789 +0000 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.353 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.353 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:15:32.415 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-18T03:15:32.415 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-18T03:15:32.415 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000162116 s, 3.2 MB/s 2026-02-18T03:15:32.416 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:15:32.472 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_4 2026-02-18T03:15:32.527 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:15:32.528 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:32.528 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 1604 Links: 1 2026-02-18T03:15:32.528 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:32.528 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:32.528 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-18 03:15:18.287264789 +0000 2026-02-18T03:15:32.528 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.528 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.528 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-18 03:14:03.771808796 +0000 2026-02-18T03:15:32.528 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:15:32.590 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-18T03:15:32.590 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-18T03:15:32.590 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000145995 s, 3.5 MB/s 2026-02-18T03:15:32.592 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:15:32.649 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:15:32.650 DEBUG:teuthology.orchestra.run.trial119:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:15:32.669 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:15:32.669 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_1 2026-02-18T03:15:32.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:32 trial114 ceph-mon[23907]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:32.725 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:15:32.725 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:32.726 INFO:teuthology.orchestra.run.trial119.stdout:Device: 6h/6d Inode: 1591 Links: 1 2026-02-18T03:15:32.726 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:32.726 INFO:teuthology.orchestra.run.trial119.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:32.726 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-18 03:15:17.053172581 +0000 2026-02-18T03:15:32.726 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-18 03:14:17.964565451 +0000 2026-02-18T03:15:32.726 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-18 03:14:17.964565451 +0000 2026-02-18T03:15:32.726 INFO:teuthology.orchestra.run.trial119.stdout: Birth: 2026-02-18 03:14:17.964565451 +0000 2026-02-18T03:15:32.726 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:15:32.789 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-18T03:15:32.790 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-18T03:15:32.790 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000150571 s, 3.4 MB/s 2026-02-18T03:15:32.791 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:15:32.848 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_2 2026-02-18T03:15:32.904 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:15:32.904 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:32.904 INFO:teuthology.orchestra.run.trial119.stdout:Device: 6h/6d Inode: 1595 Links: 1 2026-02-18T03:15:32.904 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:32.905 INFO:teuthology.orchestra.run.trial119.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:32.905 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-18 03:15:17.054172568 +0000 2026-02-18T03:15:32.905 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:32.905 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:32.905 INFO:teuthology.orchestra.run.trial119.stdout: Birth: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:32.905 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:15:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:32 trial119 ceph-mon[24143]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:32.966 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-18T03:15:32.966 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-18T03:15:32.966 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000156001 s, 3.3 MB/s 2026-02-18T03:15:32.967 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:15:33.022 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_3 2026-02-18T03:15:33.078 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:15:33.078 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:33.078 INFO:teuthology.orchestra.run.trial119.stdout:Device: 6h/6d Inode: 1607 Links: 1 2026-02-18T03:15:33.078 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:33.078 INFO:teuthology.orchestra.run.trial119.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:33.079 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-18 03:15:17.054172568 +0000 2026-02-18T03:15:33.079 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:33.079 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:33.079 INFO:teuthology.orchestra.run.trial119.stdout: Birth: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:33.079 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:15:33.144 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-18T03:15:33.144 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-18T03:15:33.144 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000149679 s, 3.4 MB/s 2026-02-18T03:15:33.146 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:15:33.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:32 trial097 ceph-mon[21799]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:33.202 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_4 2026-02-18T03:15:33.261 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:15:33.261 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:33.261 INFO:teuthology.orchestra.run.trial119.stdout:Device: 6h/6d Inode: 1606 Links: 1 2026-02-18T03:15:33.261 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:33.261 INFO:teuthology.orchestra.run.trial119.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:33.261 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-18 03:15:17.054172568 +0000 2026-02-18T03:15:33.262 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:33.262 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:33.262 INFO:teuthology.orchestra.run.trial119.stdout: Birth: 2026-02-18 03:14:17.965565426 +0000 2026-02-18T03:15:33.262 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:15:33.325 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-18T03:15:33.325 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-18T03:15:33.325 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000142315 s, 3.6 MB/s 2026-02-18T03:15:33.327 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:15:33.384 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:15:33.384 DEBUG:teuthology.orchestra.run.trial194:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:15:33.404 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:15:33.404 DEBUG:teuthology.orchestra.run.trial194:> stat /dev/vg_nvme/lv_1 2026-02-18T03:15:33.460 INFO:teuthology.orchestra.run.trial194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:15:33.460 INFO:teuthology.orchestra.run.trial194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:33.461 INFO:teuthology.orchestra.run.trial194.stdout:Device: 6h/6d Inode: 1667 Links: 1 2026-02-18T03:15:33.461 INFO:teuthology.orchestra.run.trial194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:33.461 INFO:teuthology.orchestra.run.trial194.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:33.461 INFO:teuthology.orchestra.run.trial194.stdout:Access: 2026-02-18 03:15:15.392928617 +0000 2026-02-18T03:15:33.461 INFO:teuthology.orchestra.run.trial194.stdout:Modify: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.461 INFO:teuthology.orchestra.run.trial194.stdout:Change: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.461 INFO:teuthology.orchestra.run.trial194.stdout: Birth: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.461 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:15:33.524 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records in 2026-02-18T03:15:33.524 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records out 2026-02-18T03:15:33.525 INFO:teuthology.orchestra.run.trial194.stderr:512 bytes copied, 0.000234978 s, 2.2 MB/s 2026-02-18T03:15:33.526 DEBUG:teuthology.orchestra.run.trial194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:15:33.583 DEBUG:teuthology.orchestra.run.trial194:> stat /dev/vg_nvme/lv_2 2026-02-18T03:15:33.641 INFO:teuthology.orchestra.run.trial194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:15:33.641 INFO:teuthology.orchestra.run.trial194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:33.641 INFO:teuthology.orchestra.run.trial194.stdout:Device: 6h/6d Inode: 1678 Links: 1 2026-02-18T03:15:33.641 INFO:teuthology.orchestra.run.trial194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:33.641 INFO:teuthology.orchestra.run.trial194.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:33.642 INFO:teuthology.orchestra.run.trial194.stdout:Access: 2026-02-18 03:15:15.392928617 +0000 2026-02-18T03:15:33.642 INFO:teuthology.orchestra.run.trial194.stdout:Modify: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.642 INFO:teuthology.orchestra.run.trial194.stdout:Change: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.642 INFO:teuthology.orchestra.run.trial194.stdout: Birth: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.642 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:15:33.705 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records in 2026-02-18T03:15:33.705 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records out 2026-02-18T03:15:33.705 INFO:teuthology.orchestra.run.trial194.stderr:512 bytes copied, 0.000212025 s, 2.4 MB/s 2026-02-18T03:15:33.707 DEBUG:teuthology.orchestra.run.trial194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:15:33.765 DEBUG:teuthology.orchestra.run.trial194:> stat /dev/vg_nvme/lv_3 2026-02-18T03:15:33.820 INFO:teuthology.orchestra.run.trial194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:15:33.820 INFO:teuthology.orchestra.run.trial194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:33.821 INFO:teuthology.orchestra.run.trial194.stdout:Device: 6h/6d Inode: 1665 Links: 1 2026-02-18T03:15:33.821 INFO:teuthology.orchestra.run.trial194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:33.821 INFO:teuthology.orchestra.run.trial194.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:33.821 INFO:teuthology.orchestra.run.trial194.stdout:Access: 2026-02-18 03:15:15.392928617 +0000 2026-02-18T03:15:33.821 INFO:teuthology.orchestra.run.trial194.stdout:Modify: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.821 INFO:teuthology.orchestra.run.trial194.stdout:Change: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.821 INFO:teuthology.orchestra.run.trial194.stdout: Birth: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.821 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:15:33.883 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records in 2026-02-18T03:15:33.883 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records out 2026-02-18T03:15:33.883 INFO:teuthology.orchestra.run.trial194.stderr:512 bytes copied, 0.000145311 s, 3.5 MB/s 2026-02-18T03:15:33.885 DEBUG:teuthology.orchestra.run.trial194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:15:33.941 DEBUG:teuthology.orchestra.run.trial194:> stat /dev/vg_nvme/lv_4 2026-02-18T03:15:33.998 INFO:teuthology.orchestra.run.trial194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:15:33.998 INFO:teuthology.orchestra.run.trial194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:15:33.998 INFO:teuthology.orchestra.run.trial194.stdout:Device: 6h/6d Inode: 1661 Links: 1 2026-02-18T03:15:33.999 INFO:teuthology.orchestra.run.trial194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:15:33.999 INFO:teuthology.orchestra.run.trial194.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:15:33.999 INFO:teuthology.orchestra.run.trial194.stdout:Access: 2026-02-18 03:15:15.392928617 +0000 2026-02-18T03:15:33.999 INFO:teuthology.orchestra.run.trial194.stdout:Modify: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.999 INFO:teuthology.orchestra.run.trial194.stdout:Change: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:33.999 INFO:teuthology.orchestra.run.trial194.stdout: Birth: 2026-02-18 03:14:02.641700099 +0000 2026-02-18T03:15:34.000 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:15:34.062 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records in 2026-02-18T03:15:34.063 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records out 2026-02-18T03:15:34.063 INFO:teuthology.orchestra.run.trial194.stderr:512 bytes copied, 0.000173833 s, 2.9 MB/s 2026-02-18T03:15:34.064 DEBUG:teuthology.orchestra.run.trial194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:15:34.121 INFO:tasks.cephadm:Deploying osd.0 on trial097 with /dev/vg_nvme/lv_4... 2026-02-18T03:15:34.121 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-18T03:15:34.238 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:34.666 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:15:34.685 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch daemon add osd trial097:vg_nvme/lv_4 --skip-validation 2026-02-18T03:15:34.707 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:34 trial097 ceph-mon[21799]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:34.802 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:15:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:34 trial119 ceph-mon[24143]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:34 trial114 ceph-mon[23907]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial097:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: osd.default does not exist. Creating it now. 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: Creating OSDs with service ID: default on trial097:['vg_nvme/lv_4'] 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: Marking host: trial097 for OSDSpec preview refresh. 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: Saving service osd.default spec with placement trial097 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.105 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1325928272' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9666932f-bcb9-4eea-ba9c-97157e380cc5"} : dispatch 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1325928272' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9666932f-bcb9-4eea-ba9c-97157e380cc5"}]': finished 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: osdmap e5: 1 total, 0 up, 1 in 2026-02-18T03:15:36.106 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:36 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:36.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial097:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:36.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: osd.default does not exist. Creating it now. 2026-02-18T03:15:36.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: Creating OSDs with service ID: default on trial097:['vg_nvme/lv_4'] 2026-02-18T03:15:36.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: Marking host: trial097 for OSDSpec preview refresh. 2026-02-18T03:15:36.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: Saving service osd.default spec with placement trial097 2026-02-18T03:15:36.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:36.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:36.466 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1325928272' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9666932f-bcb9-4eea-ba9c-97157e380cc5"} : dispatch 2026-02-18T03:15:36.466 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1325928272' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9666932f-bcb9-4eea-ba9c-97157e380cc5"}]': finished 2026-02-18T03:15:36.466 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: osdmap e5: 1 total, 0 up, 1 in 2026-02-18T03:15:36.466 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:36 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial097:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: osd.default does not exist. Creating it now. 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: Creating OSDs with service ID: default on trial097:['vg_nvme/lv_4'] 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: Marking host: trial097 for OSDSpec preview refresh. 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: Saving service osd.default spec with placement trial097 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:36.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1325928272' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9666932f-bcb9-4eea-ba9c-97157e380cc5"} : dispatch 2026-02-18T03:15:36.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1325928272' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9666932f-bcb9-4eea-ba9c-97157e380cc5"}]': finished 2026-02-18T03:15:36.476 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: osdmap e5: 1 total, 0 up, 1 in 2026-02-18T03:15:36.476 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:36 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:37.187 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1922989123' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:37.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1922989123' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:37.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1922989123' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:38.283 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:38 trial097 ceph-mon[21799]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:38.283 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:38 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:15:38.283 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:38 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:38.283 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:38 trial097 ceph-mon[21799]: Deploying daemon osd.0 on trial097 2026-02-18T03:15:38.283 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:38 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:15:38.283 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:38 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:38.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:38 trial119 ceph-mon[24143]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:38.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:38 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:15:38.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:38 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:38.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:38 trial119 ceph-mon[24143]: Deploying daemon osd.0 on trial097 2026-02-18T03:15:38.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:38 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:15:38.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:38 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:38.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:38 trial114 ceph-mon[23907]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:38.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:38 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:15:38.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:38 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:38.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:38 trial114 ceph-mon[23907]: Deploying daemon osd.0 on trial097 2026-02-18T03:15:38.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:38 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:15:38.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:38 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:39.364 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:39 trial119 ceph-mon[24143]: Deploying daemon osd.0 on trial097 2026-02-18T03:15:39.379 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:39 trial097 ceph-mon[21799]: Deploying daemon osd.0 on trial097 2026-02-18T03:15:39.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:39 trial114 ceph-mon[23907]: Deploying daemon osd.0 on trial097 2026-02-18T03:15:40.710 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:40 trial097 ceph-mon[21799]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:40.710 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:40 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:40.710 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:40 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:40.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:40 trial119 ceph-mon[24143]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:40.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:40 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:40.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:40 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:40.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:40 trial114 ceph-mon[23907]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:40.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:40 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:40.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:40 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.265 INFO:teuthology.orchestra.run.trial097.stdout:Created osd(s) 0 on host 'trial097' 2026-02-18T03:15:42.307 DEBUG:teuthology.orchestra.run.trial097:osd.0> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.0.service 2026-02-18T03:15:42.349 INFO:tasks.cephadm:Deploying osd.1 on trial114 with /dev/vg_nvme/lv_4... 2026-02-18T03:15:42.349 DEBUG:teuthology.orchestra.run.trial114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-18T03:15:42.467 INFO:teuthology.orchestra.run.trial114.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.b/config 2026-02-18T03:15:42.663 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:42 trial114 ceph-mon[23907]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:42.663 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:42 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.664 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:42 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.664 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:42 trial114 ceph-mon[23907]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-18T03:15:42.664 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:42 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.664 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:42 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:42 trial097 ceph-mon[21799]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:42 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:42 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:42 trial097 ceph-mon[21799]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-18T03:15:42.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:42 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:42 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:42 trial119 ceph-mon[24143]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:42.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:42 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:42 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:42 trial119 ceph-mon[24143]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-18T03:15:42.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:42 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:42.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:42 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.005 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-18T03:15:43.020 DEBUG:teuthology.orchestra.run.trial114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch daemon add osd trial114:vg_nvme/lv_4 --skip-validation 2026-02-18T03:15:43.138 INFO:teuthology.orchestra.run.trial114.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.b/config 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: osdmap e6: 1 total, 0 up, 1 in 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial097", "root=default"]} : dispatch 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.636 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.637 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:15:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0[36099]: 2026-02-18T03:15:43.538+0000 7fabc81e4640 -1 osd.0 0 waiting for initial osdmap 2026-02-18T03:15:43.637 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:15:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0[36099]: 2026-02-18T03:15:43.540+0000 7fabc37cc640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: osdmap e6: 1 total, 0 up, 1 in 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial097", "root=default"]} : dispatch 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.859 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: osdmap e6: 1 total, 0 up, 1 in 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial097", "root=default"]} : dispatch 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial114:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:44.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: osd.default does not exist. Creating it now. 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: Creating OSDs with service ID: default on trial114:['vg_nvme/lv_4'] 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: Marking host: trial114 for OSDSpec preview refresh. 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: Saving service osd.default spec with placement trial114 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial097", "root=default"]}]': finished 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: osdmap e7: 1 total, 0 up, 1 in 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1792541311' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"} : dispatch 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"} : dispatch 2026-02-18T03:15:44.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"}]': finished 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703] boot 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: osdmap e8: 2 total, 1 up, 2 in 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:44.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.727 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:44.727 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:44.727 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:44.727 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/657959008' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:44.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial114:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:44.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: osd.default does not exist. Creating it now. 2026-02-18T03:15:44.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: Creating OSDs with service ID: default on trial114:['vg_nvme/lv_4'] 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: Marking host: trial114 for OSDSpec preview refresh. 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: Saving service osd.default spec with placement trial114 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial097", "root=default"]}]': finished 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: osdmap e7: 1 total, 0 up, 1 in 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1792541311' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"} : dispatch 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"} : dispatch 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"}]': finished 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703] boot 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: osdmap e8: 2 total, 1 up, 2 in 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/657959008' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial114:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: osd.default does not exist. Creating it now. 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: Creating OSDs with service ID: default on trial114:['vg_nvme/lv_4'] 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: Marking host: trial114 for OSDSpec preview refresh. 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: Saving service osd.default spec with placement trial114 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial097", "root=default"]}]': finished 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: osdmap e7: 1 total, 0 up, 1 in 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1792541311' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"} : dispatch 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"} : dispatch 2026-02-18T03:15:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb"}]': finished 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: osd.0 [v2:10.20.193.97:6802/43548703,v1:10.20.193.97:6803/43548703] boot 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: osdmap e8: 2 total, 1 up, 2 in 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:44.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:44.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:44.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/657959008' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:45.801 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:45 trial114 ceph-mon[23907]: purged_snaps scrub starts 2026-02-18T03:15:45.801 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:45 trial114 ceph-mon[23907]: purged_snaps scrub ok 2026-02-18T03:15:45.801 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:45 trial114 ceph-mon[23907]: Detected new or changed devices on trial097 2026-02-18T03:15:45.801 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:45 trial114 ceph-mon[23907]: Adjusting osd_memory_target on trial097 to 84047M 2026-02-18T03:15:45.801 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:45 trial114 ceph-mon[23907]: osdmap e9: 2 total, 1 up, 2 in 2026-02-18T03:15:45.801 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:45 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:45.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:45 trial097 ceph-mon[21799]: purged_snaps scrub starts 2026-02-18T03:15:45.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:45 trial097 ceph-mon[21799]: purged_snaps scrub ok 2026-02-18T03:15:45.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:45 trial097 ceph-mon[21799]: Detected new or changed devices on trial097 2026-02-18T03:15:45.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:45 trial097 ceph-mon[21799]: Adjusting osd_memory_target on trial097 to 84047M 2026-02-18T03:15:45.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:45 trial097 ceph-mon[21799]: osdmap e9: 2 total, 1 up, 2 in 2026-02-18T03:15:45.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:45 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:45 trial119 ceph-mon[24143]: purged_snaps scrub starts 2026-02-18T03:15:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:45 trial119 ceph-mon[24143]: purged_snaps scrub ok 2026-02-18T03:15:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:45 trial119 ceph-mon[24143]: Detected new or changed devices on trial097 2026-02-18T03:15:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:45 trial119 ceph-mon[24143]: Adjusting osd_memory_target on trial097 to 84047M 2026-02-18T03:15:45.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:45 trial119 ceph-mon[24143]: osdmap e9: 2 total, 1 up, 2 in 2026-02-18T03:15:45.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:45 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:46.641 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:46 trial114 ceph-mon[23907]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:46.642 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:46 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:15:46.642 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:46 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:46.642 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:46 trial114 ceph-mon[23907]: Deploying daemon osd.1 on trial114 2026-02-18T03:15:46.642 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:46 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:15:46.642 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:46 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:46.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:46 trial097 ceph-mon[21799]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:46.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:46 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:15:46.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:46 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:46.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:46 trial097 ceph-mon[21799]: Deploying daemon osd.1 on trial114 2026-02-18T03:15:46.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:46 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:15:46.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:46 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:46 trial119 ceph-mon[24143]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:46 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:15:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:46 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:46 trial119 ceph-mon[24143]: Deploying daemon osd.1 on trial114 2026-02-18T03:15:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:46 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:15:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:46 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:47.637 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:47 trial114 ceph-mon[23907]: Deploying daemon osd.1 on trial114 2026-02-18T03:15:47.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:47 trial097 ceph-mon[21799]: Deploying daemon osd.1 on trial114 2026-02-18T03:15:47.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:47 trial119 ceph-mon[24143]: Deploying daemon osd.1 on trial114 2026-02-18T03:15:48.814 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:48 trial114 ceph-mon[23907]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:48.815 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:48 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:48.815 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:48 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:48.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:48 trial097 ceph-mon[21799]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:48.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:48 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:48.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:48 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:48 trial119 ceph-mon[24143]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:48 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:48 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:50.609 INFO:teuthology.orchestra.run.trial114.stdout:Created osd(s) 1 on host 'trial114' 2026-02-18T03:15:50.649 DEBUG:teuthology.orchestra.run.trial114:osd.1> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.1.service 2026-02-18T03:15:50.652 INFO:tasks.cephadm:Deploying osd.2 on trial119 with /dev/vg_nvme/lv_4... 2026-02-18T03:15:50.652 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-18T03:15:50.769 INFO:teuthology.orchestra.run.trial119.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.c/config 2026-02-18T03:15:50.807 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:50 trial119 ceph-mon[24143]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:50.807 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:50 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:50.807 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:50 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:50.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:50 trial097 ceph-mon[21799]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:50.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:50 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:50.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:50 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:50 trial114 ceph-mon[23907]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:50 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:50 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.208 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-18T03:15:51.224 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch daemon add osd trial119:vg_nvme/lv_4 --skip-validation 2026-02-18T03:15:51.343 INFO:teuthology.orchestra.run.trial119.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.c/config 2026-02-18T03:15:51.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:51 trial119 ceph-mon[24143]: from='osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:15:51.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:51 trial119 ceph-mon[24143]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:15:51.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:51 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:51 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:51 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:51 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:51 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:51.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:51 trial097 ceph-mon[21799]: from='osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:15:51.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:51 trial097 ceph-mon[21799]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:15:51.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:51 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:51 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:51 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:51 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:51 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:51.932 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:51 trial114 ceph-mon[23907]: from='osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:15:51.932 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:51 trial114 ceph-mon[23907]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:15:51.932 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:51 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.932 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:51 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.932 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:51 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.932 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:51 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:51.932 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:51 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:15:52.638 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:52.639 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-18T03:15:52.639 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]} : dispatch 2026-02-18T03:15:52.639 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: osdmap e10: 2 total, 1 up, 2 in 2026-02-18T03:15:52.639 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.639 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]} : dispatch 2026-02-18T03:15:52.639 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial119:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:52.639 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: osd.default does not exist. Creating it now. 2026-02-18T03:15:52.639 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: Creating OSDs with service ID: default on trial119:['vg_nvme/lv_4'] 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: Marking host: trial119 for OSDSpec preview refresh. 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: Saving service osd.default spec with placement trial119 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.640 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2854223510' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"} : dispatch 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"} : dispatch 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]}]': finished 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"}]': finished 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: osdmap e11: 3 total, 1 up, 3 in 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.641 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:52.642 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:52 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:52.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:52.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]} : dispatch 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: osdmap e10: 2 total, 1 up, 2 in 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]} : dispatch 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial119:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: osd.default does not exist. Creating it now. 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: Creating OSDs with service ID: default on trial119:['vg_nvme/lv_4'] 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: Marking host: trial119 for OSDSpec preview refresh. 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: Saving service osd.default spec with placement trial119 2026-02-18T03:15:52.725 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2854223510' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"} : dispatch 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"} : dispatch 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]}]': finished 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"}]': finished 2026-02-18T03:15:52.726 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: osdmap e11: 3 total, 1 up, 3 in 2026-02-18T03:15:52.727 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.727 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:52.727 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.727 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.727 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:15:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1[28801]: 2026-02-18T03:15:52.302+0000 7f51eec3d640 -1 osd.1 0 waiting for initial osdmap 2026-02-18T03:15:52.727 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:15:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1[28801]: 2026-02-18T03:15:52.304+0000 7f51e621d640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:52.728 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:52.729 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.729 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:52.729 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:52.729 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:52 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:52.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:15:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-18T03:15:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]} : dispatch 2026-02-18T03:15:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: osdmap e10: 2 total, 1 up, 2 in 2026-02-18T03:15:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]} : dispatch 2026-02-18T03:15:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial119:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:15:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: osd.default does not exist. Creating it now. 2026-02-18T03:15:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: Creating OSDs with service ID: default on trial119:['vg_nvme/lv_4'] 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: Marking host: trial119 for OSDSpec preview refresh. 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: Saving service osd.default spec with placement trial119 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2854223510' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"} : dispatch 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"} : dispatch 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial114", "root=default"]}]': finished 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16a22642-c08a-4954-9977-824a1126ab37"}]': finished 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: osdmap e11: 3 total, 1 up, 3 in 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:52.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:52.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:15:52.909 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:52.909 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:15:52.909 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:15:52.909 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:52 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:53.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:53 trial119 ceph-mon[24143]: Detected new or changed devices on trial114 2026-02-18T03:15:53.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:53 trial119 ceph-mon[24143]: Adjusting osd_memory_target on trial114 to 88143M 2026-02-18T03:15:53.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2488285356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:53.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:53 trial119 ceph-mon[24143]: osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761] boot 2026-02-18T03:15:53.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:53 trial119 ceph-mon[24143]: osdmap e12: 3 total, 2 up, 3 in 2026-02-18T03:15:53.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:53 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:53.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:53 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:53.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:53 trial097 ceph-mon[21799]: Detected new or changed devices on trial114 2026-02-18T03:15:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:53 trial097 ceph-mon[21799]: Adjusting osd_memory_target on trial114 to 88143M 2026-02-18T03:15:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2488285356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:53 trial097 ceph-mon[21799]: osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761] boot 2026-02-18T03:15:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:53 trial097 ceph-mon[21799]: osdmap e12: 3 total, 2 up, 3 in 2026-02-18T03:15:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:53 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:53 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:53.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:53 trial114 ceph-mon[23907]: Detected new or changed devices on trial114 2026-02-18T03:15:53.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:53 trial114 ceph-mon[23907]: Adjusting osd_memory_target on trial114 to 88143M 2026-02-18T03:15:53.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2488285356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:15:53.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:53 trial114 ceph-mon[23907]: osd.1 [v2:10.20.193.114:6800/581398761,v1:10.20.193.114:6801/581398761] boot 2026-02-18T03:15:53.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:53 trial114 ceph-mon[23907]: osdmap e12: 3 total, 2 up, 3 in 2026-02-18T03:15:53.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:53 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:15:53.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:53 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:54.872 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: purged_snaps scrub starts 2026-02-18T03:15:54.872 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: purged_snaps scrub ok 2026-02-18T03:15:54.873 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:54.873 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:15:54.873 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:54.873 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:15:54.873 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:54.873 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: osdmap e13: 3 total, 2 up, 3 in 2026-02-18T03:15:54.873 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:54.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: purged_snaps scrub starts 2026-02-18T03:15:54.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: purged_snaps scrub ok 2026-02-18T03:15:54.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:15:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:15:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: osdmap e13: 3 total, 2 up, 3 in 2026-02-18T03:15:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: purged_snaps scrub starts 2026-02-18T03:15:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: purged_snaps scrub ok 2026-02-18T03:15:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:15:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:15:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:15:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: osdmap e13: 3 total, 2 up, 3 in 2026-02-18T03:15:54.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:15:55.858 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:55 trial119 ceph-mon[24143]: Deploying daemon osd.2 on trial119 2026-02-18T03:15:55.859 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:55 trial119 ceph-mon[24143]: Deploying daemon osd.2 on trial119 2026-02-18T03:15:55.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:55 trial097 ceph-mon[21799]: Deploying daemon osd.2 on trial119 2026-02-18T03:15:55.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:55 trial097 ceph-mon[21799]: Deploying daemon osd.2 on trial119 2026-02-18T03:15:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:55 trial114 ceph-mon[23907]: Deploying daemon osd.2 on trial119 2026-02-18T03:15:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:55 trial114 ceph-mon[23907]: Deploying daemon osd.2 on trial119 2026-02-18T03:15:56.682 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:56 trial119 ceph-mon[24143]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:56.682 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:56 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:56.683 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:56 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:56.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:56 trial097 ceph-mon[21799]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:56.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:56 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:56.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:56 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:56 trial114 ceph-mon[23907]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:56 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:56 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:58.814 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:58 trial119 ceph-mon[24143]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:58.814 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:58.815 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:58.863 INFO:teuthology.orchestra.run.trial119.stdout:Created osd(s) 2 on host 'trial119' 2026-02-18T03:15:58.904 DEBUG:teuthology.orchestra.run.trial119:osd.2> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.2.service 2026-02-18T03:15:58.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:58 trial097 ceph-mon[21799]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:58.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:58.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:58.906 INFO:tasks.cephadm:Deploying osd.3 on trial194 with /dev/vg_nvme/lv_4... 2026-02-18T03:15:58.907 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-18T03:15:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:58 trial114 ceph-mon[23907]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:15:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:59.024 INFO:teuthology.orchestra.run.trial194.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:59.542 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-18T03:15:59.558 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch daemon add osd trial194:vg_nvme/lv_4 --skip-validation 2026-02-18T03:15:59.719 INFO:teuthology.orchestra.run.trial194.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:15:59.881 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:59 trial119 ceph-mon[24143]: from='osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:15:59.881 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:59 trial119 ceph-mon[24143]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:15:59.882 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:59.882 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:15:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:59.882 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:59 trial114 ceph-mon[23907]: from='osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:15:59.882 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:59 trial114 ceph-mon[23907]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:15:59.882 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:59.883 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:15:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:59.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:59 trial097 ceph-mon[21799]: from='osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:15:59.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:59 trial097 ceph-mon[21799]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:15:59.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:15:59.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:15:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:16:00.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-18T03:16:00.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]} : dispatch 2026-02-18T03:16:00.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: osdmap e14: 3 total, 2 up, 3 in 2026-02-18T03:16:00.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:00.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]} : dispatch 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:16:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-18T03:16:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]} : dispatch 2026-02-18T03:16:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: osdmap e14: 3 total, 2 up, 3 in 2026-02-18T03:16:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]} : dispatch 2026-02-18T03:16:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.966 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2[29128]: 2026-02-18T03:16:00.568+0000 7f6dec060640 -1 osd.2 0 waiting for initial osdmap 2026-02-18T03:16:00.966 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2[29128]: 2026-02-18T03:16:00.570+0000 7f6de7648640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:16:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:16:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-18T03:16:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]} : dispatch 2026-02-18T03:16:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: osdmap e14: 3 total, 2 up, 3 in 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]} : dispatch 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:00.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:00.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial194:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:01.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: osd.default does not exist. Creating it now. 2026-02-18T03:16:01.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: Creating OSDs with service ID: default on trial194:['vg_nvme/lv_4'] 2026-02-18T03:16:01.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: Marking host: trial194 for OSDSpec preview refresh. 2026-02-18T03:16:01.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: Saving service osd.default spec with placement trial194 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]}]': finished 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: osdmap e15: 3 total, 2 up, 3 in 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3491069786' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"} : dispatch 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"} : dispatch 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"}]': finished 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: Detected new or changed devices on trial119 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071] boot 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: osdmap e16: 4 total, 3 up, 4 in 2026-02-18T03:16:01.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:01.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:01.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:01.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:01.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:01.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1173186106' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:16:01.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial194:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: osd.default does not exist. Creating it now. 2026-02-18T03:16:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: Creating OSDs with service ID: default on trial194:['vg_nvme/lv_4'] 2026-02-18T03:16:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: Marking host: trial194 for OSDSpec preview refresh. 2026-02-18T03:16:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: Saving service osd.default spec with placement trial194 2026-02-18T03:16:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]}]': finished 2026-02-18T03:16:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: osdmap e15: 3 total, 2 up, 3 in 2026-02-18T03:16:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3491069786' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"} : dispatch 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"} : dispatch 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"}]': finished 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: Detected new or changed devices on trial119 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071] boot 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: osdmap e16: 4 total, 3 up, 4 in 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:01.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:01.967 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:01 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1173186106' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:16:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial194:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: osd.default does not exist. Creating it now. 2026-02-18T03:16:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: Creating OSDs with service ID: default on trial194:['vg_nvme/lv_4'] 2026-02-18T03:16:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: Marking host: trial194 for OSDSpec preview refresh. 2026-02-18T03:16:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: Saving service osd.default spec with placement trial194 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial119", "root=default"]}]': finished 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: osdmap e15: 3 total, 2 up, 3 in 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3491069786' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"} : dispatch 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"} : dispatch 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63"}]': finished 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: Detected new or changed devices on trial119 2026-02-18T03:16:01.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: osd.2 [v2:10.20.193.119:6800/1476025071,v1:10.20.193.119:6801/1476025071] boot 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: osdmap e16: 4 total, 3 up, 4 in 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:01.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:01.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:01.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:01.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:01.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:01.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:01 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1173186106' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:16:02.842 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: purged_snaps scrub starts 2026-02-18T03:16:02.842 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: purged_snaps scrub ok 2026-02-18T03:16:02.842 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: Adjusting osd_memory_target on trial119 to 88143M 2026-02-18T03:16:02.842 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:16:02.842 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:16:02.842 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-18T03:16:02.843 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: osdmap e17: 4 total, 3 up, 4 in 2026-02-18T03:16:02.843 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:02.843 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:16:02.843 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:16:02.843 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:02.875 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33021]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-18T03:16:02.875 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33021]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:02.875 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:02.875 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33021]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:02.875 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33025]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-18T03:16:02.875 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33025]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:02.876 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:02.876 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33025]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: purged_snaps scrub starts 2026-02-18T03:16:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: purged_snaps scrub ok 2026-02-18T03:16:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: Adjusting osd_memory_target on trial119 to 88143M 2026-02-18T03:16:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:16:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:16:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-18T03:16:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: osdmap e17: 4 total, 3 up, 4 in 2026-02-18T03:16:02.877 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:02.877 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:16:02.877 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:16:02.877 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:02.888 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41023]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-18T03:16:02.888 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41023]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:02.888 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:02.888 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41023]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:02.889 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41027]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-18T03:16:02.889 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41027]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:02.889 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:02.889 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41027]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:02.889 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: purged_snaps scrub starts 2026-02-18T03:16:02.889 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: purged_snaps scrub ok 2026-02-18T03:16:02.889 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: Adjusting osd_memory_target on trial119 to 88143M 2026-02-18T03:16:02.889 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:16:02.889 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:16:02.890 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-18T03:16:02.890 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: osdmap e17: 4 total, 3 up, 4 in 2026-02-18T03:16:02.890 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:02.890 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:16:02.890 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:16:02.890 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:02.890 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41031]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-18T03:16:03.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41031]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:03.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:03.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41031]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:03.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41035]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-18T03:16:03.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41035]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:03.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:03.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:02 trial097 sudo[41035]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:03.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31746]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-18T03:16:03.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31746]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:03.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:03.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31746]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:03.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31750]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-18T03:16:03.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31750]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:03.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:03.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31750]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:03.214 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31738]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-18T03:16:03.214 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31738]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:03.214 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:03.214 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31738]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:03.215 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31742]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-18T03:16:03.215 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31742]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:03.215 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:03.215 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:16:02 trial119 sudo[31742]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:03.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33029]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-18T03:16:03.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33029]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:03.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:03.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33029]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:03.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:02 trial114 sudo[33033]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-18T03:16:03.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 sudo[33033]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:16:03.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 sudo[33033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:16:03.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 sudo[33033]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:16:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: Deploying daemon osd.3 on trial194 2026-02-18T03:16:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:16:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: Deploying daemon osd.3 on trial194 2026-02-18T03:16:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-18T03:16:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: osdmap e18: 4 total, 3 up, 4 in 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: Deploying daemon osd.3 on trial194 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: Deploying daemon osd.3 on trial194 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: osdmap e18: 4 total, 3 up, 4 in 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: Deploying daemon osd.3 on trial194 2026-02-18T03:16:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:16:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: Deploying daemon osd.3 on trial194 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: osdmap e18: 4 total, 3 up, 4 in 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:16:03.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:16:03.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:16:03.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:16:03.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:04.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:04 trial097 ceph-mon[21799]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:04 trial097 ceph-mon[21799]: osdmap e19: 4 total, 3 up, 4 in 2026-02-18T03:16:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:04 trial097 ceph-mon[21799]: mgrmap e14: x(active, since 66s) 2026-02-18T03:16:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:04 trial119 ceph-mon[24143]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:04 trial119 ceph-mon[24143]: osdmap e19: 4 total, 3 up, 4 in 2026-02-18T03:16:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:04 trial119 ceph-mon[24143]: mgrmap e14: x(active, since 66s) 2026-02-18T03:16:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:04 trial114 ceph-mon[23907]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:04 trial114 ceph-mon[23907]: osdmap e19: 4 total, 3 up, 4 in 2026-02-18T03:16:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:04 trial114 ceph-mon[23907]: mgrmap e14: x(active, since 66s) 2026-02-18T03:16:06.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:05 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:06.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:05 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:06.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:05 trial097 ceph-mon[21799]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:06.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:05 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:06.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:05 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:06.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:05 trial119 ceph-mon[24143]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:06.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:05 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:06.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:05 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:06.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:05 trial114 ceph-mon[23907]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:07.635 INFO:teuthology.orchestra.run.trial194.stdout:Created osd(s) 3 on host 'trial194' 2026-02-18T03:16:07.676 DEBUG:teuthology.orchestra.run.trial194:osd.3> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.3.service 2026-02-18T03:16:07.679 INFO:tasks.cephadm:Waiting for 4 OSDs to come up... 2026-02-18T03:16:07.679 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd stat -f json 2026-02-18T03:16:07.798 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:08.029 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.029 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.030 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:07 trial097 ceph-mon[21799]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:08.030 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:07 trial097 ceph-mon[21799]: from='osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:16:08.030 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:07 trial097 ceph-mon[21799]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:16:08.030 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.030 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:07 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.030 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:08.067 INFO:teuthology.orchestra.run.trial097.stdout:{"epoch":20,"num_osds":4,"num_up_osds":3,"osd_up_since":1771384560,"num_in_osds":4,"osd_in_since":1771384560,"num_remapped_pgs":0} 2026-02-18T03:16:08.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:07 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:07 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:07 trial119 ceph-mon[24143]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:08.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:07 trial119 ceph-mon[24143]: from='osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:16:08.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:07 trial119 ceph-mon[24143]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:16:08.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:07 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:07 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:07 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:07 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:07 trial114 ceph-mon[23907]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:08.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:07 trial114 ceph-mon[23907]: from='osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:16:08.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:07 trial114 ceph-mon[23907]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:16:08.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:07 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:07 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.956 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:16:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3[29004]: 2026-02-18T03:16:08.898+0000 7f2e0392b640 -1 osd.3 0 waiting for initial osdmap 2026-02-18T03:16:08.956 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:16:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3[29004]: 2026-02-18T03:16:08.901+0000 7f2dfef13640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:16:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-18T03:16:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]} : dispatch 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: osdmap e20: 4 total, 3 up, 4 in 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]} : dispatch 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1816332200' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:08 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.068 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd stat -f json 2026-02-18T03:16:09.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-18T03:16:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]} : dispatch 2026-02-18T03:16:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: osdmap e20: 4 total, 3 up, 4 in 2026-02-18T03:16:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]} : dispatch 2026-02-18T03:16:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1816332200' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:09.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:08 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.187 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:09.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-18T03:16:09.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]} : dispatch 2026-02-18T03:16:09.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: osdmap e20: 4 total, 3 up, 4 in 2026-02-18T03:16:09.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:09.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]} : dispatch 2026-02-18T03:16:09.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1816332200' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:09.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:09.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:08 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:09.413 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:09.451 INFO:teuthology.orchestra.run.trial097.stdout:{"epoch":21,"num_osds":4,"num_up_osds":3,"osd_up_since":1771384560,"num_in_osds":4,"osd_in_since":1771384560,"num_remapped_pgs":0} 2026-02-18T03:16:10.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]}]': finished 2026-02-18T03:16:10.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: osdmap e21: 4 total, 3 up, 4 in 2026-02-18T03:16:10.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:10.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:10.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3873384859' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: Detected new or changed devices on trial194 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: Adjusting osd_memory_target on trial194 to 89167M 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:10.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:10.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:10.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:10.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:09 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:10.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]}]': finished 2026-02-18T03:16:10.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: osdmap e21: 4 total, 3 up, 4 in 2026-02-18T03:16:10.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:10.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:10.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:10.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3873384859' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:10.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: Detected new or changed devices on trial194 2026-02-18T03:16:10.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: Adjusting osd_memory_target on trial194 to 89167M 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:10.215 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.216 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:10.216 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:10.216 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:09 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:10.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial194", "root=default"]}]': finished 2026-02-18T03:16:10.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: osdmap e21: 4 total, 3 up, 4 in 2026-02-18T03:16:10.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:10.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3873384859' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: Detected new or changed devices on trial194 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:16:10.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: Adjusting osd_memory_target on trial194 to 89167M 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:16:10.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:09 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:10.453 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd stat -f json 2026-02-18T03:16:10.572 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:10.802 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:10.841 INFO:teuthology.orchestra.run.trial097.stdout:{"epoch":22,"num_osds":4,"num_up_osds":4,"osd_up_since":1771384569,"num_in_osds":4,"osd_in_since":1771384560,"num_remapped_pgs":1} 2026-02-18T03:16:10.841 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd dump --format=json 2026-02-18T03:16:10.958 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:11.074 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:10 trial097 ceph-mon[21799]: purged_snaps scrub starts 2026-02-18T03:16:11.074 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:10 trial097 ceph-mon[21799]: purged_snaps scrub ok 2026-02-18T03:16:11.074 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:10 trial097 ceph-mon[21799]: osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384] boot 2026-02-18T03:16:11.074 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:10 trial097 ceph-mon[21799]: osdmap e22: 4 total, 4 up, 4 in 2026-02-18T03:16:11.074 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:10 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:11.074 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:10 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/718648169' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:11.186 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:11.186 INFO:teuthology.orchestra.run.trial097.stdout:{"epoch":23,"fsid":"eb431a19-0c77-11f1-b2a8-d404e6e7d460","created":"2026-02-18T03:14:37.770059+0000","modified":"2026-02-18T03:16:10.902642+0000","last_up_change":"2026-02-18T03:16:09.900306+0000","last_in_change":"2026-02-18T03:16:00.663260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T03:16:01.609211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9666932f-bcb9-4eea-ba9c-97157e380cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6802","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6803","nonce":43548703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6804","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6805","nonce":43548703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6808","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6809","nonce":43548703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6806","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6807","nonce":43548703}]},"public_addr":"10.20.193.97:6803/43548703","cluster_addr":"10.20.193.97:6805/43548703","heartbeat_back_addr":"10.20.193.97:6809/43548703","heartbeat_front_addr":"10.20.193.97:6807/43548703","state":["exists","up"]},{"osd":1,"uuid":"b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6800","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6801","nonce":581398761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6802","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6803","nonce":581398761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6806","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6807","nonce":581398761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6804","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6805","nonce":581398761}]},"public_addr":"10.20.193.114:6801/581398761","cluster_addr":"10.20.193.114:6803/581398761","heartbeat_back_addr":"10.20.193.114:6807/581398761","heartbeat_front_addr":"10.20.193.114:6805/581398761","state":["exists","up"]},{"osd":2,"uuid":"16a22642-c08a-4954-9977-824a1126ab37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6801","nonce":1476025071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6803","nonce":1476025071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6807","nonce":1476025071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6805","nonce":1476025071}]},"public_addr":"10.20.193.119:6801/1476025071","cluster_addr":"10.20.193.119:6803/1476025071","heartbeat_back_addr":"10.20.193.119:6807/1476025071","heartbeat_front_addr":"10.20.193.119:6805/1476025071","state":["exists","up"]},{"osd":3,"uuid":"9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6800","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6801","nonce":2416275384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6802","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6803","nonce":2416275384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6806","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6807","nonce":2416275384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6804","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6805","nonce":2416275384}]},"public_addr":"10.20.193.194:6801/2416275384","cluster_addr":"10.20.193.194:6803/2416275384","heartbeat_back_addr":"10.20.193.194:6807/2416275384","heartbeat_front_addr":"10.20.193.194:6805/2416275384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:43.179617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:51.618138+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:59.786289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:16:08.585487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[2,1]}],"primary_temp":[],"blocklist":{"10.20.193.97:0/1178528942":"2026-02-19T03:14:57.396928+0000","10.20.193.97:6801/892405900":"2026-02-19T03:14:57.396928+0000","10.20.193.97:6800/892405900":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/1540056638":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/3856610338":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/2179574512":"2026-02-19T03:14:47.701823+0000","10.20.193.97:0/3405867709":"2026-02-19T03:14:47.701823+0000","10.20.193.97:6801/3851791148":"2026-02-19T03:14:47.701823+0000","10.20.193.97:6800/3851791148":"2026-02-19T03:14:47.701823+0000","10.20.193.97:0/1072394780":"2026-02-19T03:14:47.701823+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T03:16:11.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:10 trial119 ceph-mon[24143]: purged_snaps scrub starts 2026-02-18T03:16:11.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:10 trial119 ceph-mon[24143]: purged_snaps scrub ok 2026-02-18T03:16:11.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:10 trial119 ceph-mon[24143]: osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384] boot 2026-02-18T03:16:11.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:10 trial119 ceph-mon[24143]: osdmap e22: 4 total, 4 up, 4 in 2026-02-18T03:16:11.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:10 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:11.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:10 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/718648169' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:11.223 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-18T03:16:01.609211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-18T03:16:11.224 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-18T03:16:11.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:10 trial114 ceph-mon[23907]: purged_snaps scrub starts 2026-02-18T03:16:11.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:10 trial114 ceph-mon[23907]: purged_snaps scrub ok 2026-02-18T03:16:11.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:10 trial114 ceph-mon[23907]: osd.3 [v2:10.20.193.194:6800/2416275384,v1:10.20.193.194:6801/2416275384] boot 2026-02-18T03:16:11.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:10 trial114 ceph-mon[23907]: osdmap e22: 4 total, 4 up, 4 in 2026-02-18T03:16:11.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:10 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:16:11.226 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:10 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/718648169' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:16:11.339 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:11.561 INFO:teuthology.orchestra.run.trial097.stdout:pg_num: 1 2026-02-18T03:16:11.598 INFO:tasks.cephadm:Setting up client nodes... 2026-02-18T03:16:11.599 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:16:11.716 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:16:11.992 INFO:teuthology.orchestra.run.trial031.stdout:[client.0] 2026-02-18T03:16:11.993 INFO:teuthology.orchestra.run.trial031.stdout: key = AQD7LpVphwEEOxAAyineXobYmVrGjn9quRrM6A== 2026-02-18T03:16:12.032 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:16:12.032 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-18T03:16:12.032 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-18T03:16:12.105 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:16:12.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:11 trial119 ceph-mon[24143]: osdmap e23: 4 total, 4 up, 4 in 2026-02-18T03:16:12.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:11 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2484111042' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:12.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:11 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:12.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:11 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:12.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:11 trial119 ceph-mon[24143]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:12.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:11 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3535664135' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:16:12.223 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:16:12.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:11 trial114 ceph-mon[23907]: osdmap e23: 4 total, 4 up, 4 in 2026-02-18T03:16:12.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:11 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2484111042' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:12.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:11 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:12.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:11 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:12.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:11 trial114 ceph-mon[23907]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:12.225 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:11 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3535664135' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:16:12.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:11 trial097 ceph-mon[21799]: osdmap e23: 4 total, 4 up, 4 in 2026-02-18T03:16:12.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:11 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2484111042' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:12.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:12.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:11 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:12.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:11 trial097 ceph-mon[21799]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:12.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:11 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3535664135' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:16:12.505 INFO:teuthology.orchestra.run.trial078.stdout:[client.1] 2026-02-18T03:16:12.506 INFO:teuthology.orchestra.run.trial078.stdout: key = AQD8LpVpxbgEHhAAuf46alb6C9Kkhc552HMCCw== 2026-02-18T03:16:12.543 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:16:12.544 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-18T03:16:12.544 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-18T03:16:12.632 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph auth get-or-create client.2 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:16:12.750 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:13.023 INFO:teuthology.orchestra.run.trial097.stdout:[client.2] 2026-02-18T03:16:13.023 INFO:teuthology.orchestra.run.trial097.stdout: key = AQD9LpVp3zBHARAAPUphVzhrMkbdHDPuXuV3Hw== 2026-02-18T03:16:13.062 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:16:13.062 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/ceph/ceph.client.2.keyring 2026-02-18T03:16:13.062 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2026-02-18T03:16:13.096 DEBUG:teuthology.orchestra.run.trial114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph auth get-or-create client.3 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:16:13.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:12 trial119 ceph-mon[24143]: osdmap e24: 4 total, 4 up, 4 in 2026-02-18T03:16:13.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.31:0/105408814' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:13.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.31:0/105408814' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:13.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.78:0/267516932' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:13.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.78:0/267516932' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:13.218 INFO:teuthology.orchestra.run.trial114.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.b/config 2026-02-18T03:16:13.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:12 trial114 ceph-mon[23907]: osdmap e24: 4 total, 4 up, 4 in 2026-02-18T03:16:13.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.31:0/105408814' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:13.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.31:0/105408814' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:13.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.78:0/267516932' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:13.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.78:0/267516932' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:13.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:12 trial097 ceph-mon[21799]: osdmap e24: 4 total, 4 up, 4 in 2026-02-18T03:16:13.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.31:0/105408814' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:13.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.31:0/105408814' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:13.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.78:0/267516932' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:13.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.78:0/267516932' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:13.496 INFO:teuthology.orchestra.run.trial114.stdout:[client.3] 2026-02-18T03:16:13.496 INFO:teuthology.orchestra.run.trial114.stdout: key = AQD9LpVpxSBYHRAANbyrReDqkalvv798gXA7gA== 2026-02-18T03:16:13.533 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:16:13.534 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/ceph/ceph.client.3.keyring 2026-02-18T03:16:13.534 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2026-02-18T03:16:13.569 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph auth get-or-create client.4 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:16:13.691 INFO:teuthology.orchestra.run.trial119.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.c/config 2026-02-18T03:16:13.969 INFO:teuthology.orchestra.run.trial119.stdout:[client.4] 2026-02-18T03:16:13.970 INFO:teuthology.orchestra.run.trial119.stdout: key = AQD9LpVpjImcORAADRitb9jfJvVphWeKkwbT/A== 2026-02-18T03:16:14.010 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:16:14.010 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/ceph/ceph.client.4.keyring 2026-02-18T03:16:14.010 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0644 /etc/ceph/ceph.client.4.keyring 2026-02-18T03:16:14.048 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph auth get-or-create client.5 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:16:14.168 INFO:teuthology.orchestra.run.trial194.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:16:14.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:13 trial119 ceph-mon[24143]: osdmap e25: 4 total, 4 up, 4 in 2026-02-18T03:16:14.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1141727760' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1141727760' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:14.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:13 trial119 ceph-mon[24143]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:14.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/346808880' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:13 trial119 ceph-mon[24143]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:13 trial119 ceph-mon[24143]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:14.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:13 trial114 ceph-mon[23907]: osdmap e25: 4 total, 4 up, 4 in 2026-02-18T03:16:14.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1141727760' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1141727760' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:14.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:13 trial114 ceph-mon[23907]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:14.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/346808880' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:13 trial114 ceph-mon[23907]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:13 trial114 ceph-mon[23907]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:14.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:13 trial097 ceph-mon[21799]: osdmap e25: 4 total, 4 up, 4 in 2026-02-18T03:16:14.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1141727760' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1141727760' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:14.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:13 trial097 ceph-mon[21799]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:14.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/346808880' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:13 trial097 ceph-mon[21799]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:14.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:13 trial097 ceph-mon[21799]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:14.443 INFO:teuthology.orchestra.run.trial194.stdout:[client.5] 2026-02-18T03:16:14.443 INFO:teuthology.orchestra.run.trial194.stdout: key = AQD+LpVpvtcsGhAAT5TWasObRsNO9KKrsXS18w== 2026-02-18T03:16:14.480 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:16:14.480 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/ceph/ceph.client.5.keyring 2026-02-18T03:16:14.480 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod 0644 /etc/ceph/ceph.client.5.keyring 2026-02-18T03:16:14.516 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-18T03:16:14.632 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:14.858 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:14.894 INFO:teuthology.orchestra.run.trial097.stdout:[{"version":13,"timestamp":"2026-02-18T03:16:09.495997+0000","name":"","changes":[{"name":"osd/host:trial194/osd_memory_target","new_value":"93498629324"}]}] 2026-02-18T03:16:14.895 INFO:tasks.ceph_manager:config epoch is 13 2026-02-18T03:16:14.895 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-18T03:16:14.895 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-18T03:16:14.895 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-18T03:16:15.011 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:15.126 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:14 trial097 ceph-mon[21799]: osdmap e26: 4 total, 4 up, 4 in 2026-02-18T03:16:15.126 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3399411292' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.126 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:14 trial097 ceph-mon[21799]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.127 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:14 trial097 ceph-mon[21799]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:15.127 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1475445297' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.127 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:14 trial097 ceph-mon[21799]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.127 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:14 trial097 ceph-mon[21799]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:15.127 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4292554072' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-18T03:16:15.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:14 trial119 ceph-mon[24143]: osdmap e26: 4 total, 4 up, 4 in 2026-02-18T03:16:15.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3399411292' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:14 trial119 ceph-mon[24143]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:14 trial119 ceph-mon[24143]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:15.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1475445297' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:14 trial119 ceph-mon[24143]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:14 trial119 ceph-mon[24143]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:15.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4292554072' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-18T03:16:15.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:14 trial114 ceph-mon[23907]: osdmap e26: 4 total, 4 up, 4 in 2026-02-18T03:16:15.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3399411292' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:14 trial114 ceph-mon[23907]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:14 trial114 ceph-mon[23907]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:15.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1475445297' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:14 trial114 ceph-mon[23907]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:16:15.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:14 trial114 ceph-mon[23907]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.5", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:16:15.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4292554072' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-18T03:16:15.265 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:15.302 INFO:teuthology.orchestra.run.trial097.stdout:{"epoch":14,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6800","nonce":3042014206},{"type":"v1","addr":"10.20.193.97:6801","nonce":3042014206}]},"active_addr":"10.20.193.97:6801/3042014206","active_change":"2026-02-18T03:14:57.397052+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.97:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.97:0","nonce":3929044715}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.97:0","nonce":4109298148}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.97:0","nonce":1633926908}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.97:0","nonce":2641026780}]}]} 2026-02-18T03:16:15.306 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-18T03:16:15.306 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-18T03:16:15.306 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd dump --format=json 2026-02-18T03:16:15.421 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:15.655 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:15.655 INFO:teuthology.orchestra.run.trial097.stdout:{"epoch":26,"fsid":"eb431a19-0c77-11f1-b2a8-d404e6e7d460","created":"2026-02-18T03:14:37.770059+0000","modified":"2026-02-18T03:16:13.912777+0000","last_up_change":"2026-02-18T03:16:09.900306+0000","last_in_change":"2026-02-18T03:16:00.663260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T03:16:01.609211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9666932f-bcb9-4eea-ba9c-97157e380cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6802","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6803","nonce":43548703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6804","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6805","nonce":43548703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6808","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6809","nonce":43548703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6806","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6807","nonce":43548703}]},"public_addr":"10.20.193.97:6803/43548703","cluster_addr":"10.20.193.97:6805/43548703","heartbeat_back_addr":"10.20.193.97:6809/43548703","heartbeat_front_addr":"10.20.193.97:6807/43548703","state":["exists","up"]},{"osd":1,"uuid":"b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6800","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6801","nonce":581398761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6802","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6803","nonce":581398761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6806","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6807","nonce":581398761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6804","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6805","nonce":581398761}]},"public_addr":"10.20.193.114:6801/581398761","cluster_addr":"10.20.193.114:6803/581398761","heartbeat_back_addr":"10.20.193.114:6807/581398761","heartbeat_front_addr":"10.20.193.114:6805/581398761","state":["exists","up"]},{"osd":2,"uuid":"16a22642-c08a-4954-9977-824a1126ab37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6801","nonce":1476025071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6803","nonce":1476025071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6807","nonce":1476025071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6805","nonce":1476025071}]},"public_addr":"10.20.193.119:6801/1476025071","cluster_addr":"10.20.193.119:6803/1476025071","heartbeat_back_addr":"10.20.193.119:6807/1476025071","heartbeat_front_addr":"10.20.193.119:6805/1476025071","state":["exists","up"]},{"osd":3,"uuid":"9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6800","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6801","nonce":2416275384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6802","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6803","nonce":2416275384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6806","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6807","nonce":2416275384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6804","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6805","nonce":2416275384}]},"public_addr":"10.20.193.194:6801/2416275384","cluster_addr":"10.20.193.194:6803/2416275384","heartbeat_back_addr":"10.20.193.194:6807/2416275384","heartbeat_front_addr":"10.20.193.194:6805/2416275384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:43.179617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:51.618138+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:59.786289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:16:08.585487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.97:0/1178528942":"2026-02-19T03:14:57.396928+0000","10.20.193.97:6801/892405900":"2026-02-19T03:14:57.396928+0000","10.20.193.97:6800/892405900":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/1540056638":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/3856610338":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/2179574512":"2026-02-19T03:14:47.701823+0000","10.20.193.97:0/3405867709":"2026-02-19T03:14:47.701823+0000","10.20.193.97:6801/3851791148":"2026-02-19T03:14:47.701823+0000","10.20.193.97:6800/3851791148":"2026-02-19T03:14:47.701823+0000","10.20.193.97:0/1072394780":"2026-02-19T03:14:47.701823+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T03:16:15.692 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-18T03:16:15.692 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd dump --format=json 2026-02-18T03:16:15.807 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.038 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:16.038 INFO:teuthology.orchestra.run.trial097.stdout:{"epoch":26,"fsid":"eb431a19-0c77-11f1-b2a8-d404e6e7d460","created":"2026-02-18T03:14:37.770059+0000","modified":"2026-02-18T03:16:13.912777+0000","last_up_change":"2026-02-18T03:16:09.900306+0000","last_in_change":"2026-02-18T03:16:00.663260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T03:16:01.609211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9666932f-bcb9-4eea-ba9c-97157e380cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6802","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6803","nonce":43548703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6804","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6805","nonce":43548703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6808","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6809","nonce":43548703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6806","nonce":43548703},{"type":"v1","addr":"10.20.193.97:6807","nonce":43548703}]},"public_addr":"10.20.193.97:6803/43548703","cluster_addr":"10.20.193.97:6805/43548703","heartbeat_back_addr":"10.20.193.97:6809/43548703","heartbeat_front_addr":"10.20.193.97:6807/43548703","state":["exists","up"]},{"osd":1,"uuid":"b5a3f21a-0cc3-43bb-bbe9-971833aa7bdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6800","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6801","nonce":581398761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6802","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6803","nonce":581398761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6806","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6807","nonce":581398761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6804","nonce":581398761},{"type":"v1","addr":"10.20.193.114:6805","nonce":581398761}]},"public_addr":"10.20.193.114:6801/581398761","cluster_addr":"10.20.193.114:6803/581398761","heartbeat_back_addr":"10.20.193.114:6807/581398761","heartbeat_front_addr":"10.20.193.114:6805/581398761","state":["exists","up"]},{"osd":2,"uuid":"16a22642-c08a-4954-9977-824a1126ab37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6801","nonce":1476025071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6803","nonce":1476025071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6807","nonce":1476025071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":1476025071},{"type":"v1","addr":"10.20.193.119:6805","nonce":1476025071}]},"public_addr":"10.20.193.119:6801/1476025071","cluster_addr":"10.20.193.119:6803/1476025071","heartbeat_back_addr":"10.20.193.119:6807/1476025071","heartbeat_front_addr":"10.20.193.119:6805/1476025071","state":["exists","up"]},{"osd":3,"uuid":"9fee2f1c-d2f8-4f1b-910a-4853d6cc8d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6800","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6801","nonce":2416275384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6802","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6803","nonce":2416275384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6806","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6807","nonce":2416275384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.194:6804","nonce":2416275384},{"type":"v1","addr":"10.20.193.194:6805","nonce":2416275384}]},"public_addr":"10.20.193.194:6801/2416275384","cluster_addr":"10.20.193.194:6803/2416275384","heartbeat_back_addr":"10.20.193.194:6807/2416275384","heartbeat_front_addr":"10.20.193.194:6805/2416275384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:43.179617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:51.618138+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:15:59.786289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:16:08.585487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.97:0/1178528942":"2026-02-19T03:14:57.396928+0000","10.20.193.97:6801/892405900":"2026-02-19T03:14:57.396928+0000","10.20.193.97:6800/892405900":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/1540056638":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/3856610338":"2026-02-19T03:14:57.396928+0000","10.20.193.97:0/2179574512":"2026-02-19T03:14:47.701823+0000","10.20.193.97:0/3405867709":"2026-02-19T03:14:47.701823+0000","10.20.193.97:6801/3851791148":"2026-02-19T03:14:47.701823+0000","10.20.193.97:6800/3851791148":"2026-02-19T03:14:47.701823+0000","10.20.193.97:0/1072394780":"2026-02-19T03:14:47.701823+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T03:16:16.075 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-18T03:16:16.076 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-18T03:16:16.077 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-18T03:16:16.077 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-18T03:16:16.195 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.202 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.205 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:15 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1805495415' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-18T03:16:16.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:15 trial119 ceph-mon[24143]: pgmap v55: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:16.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:15 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2254564786' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:16.215 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.218 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1805495415' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-18T03:16:16.218 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:15 trial097 ceph-mon[21799]: pgmap v55: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:16.218 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2254564786' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:16.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:15 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1805495415' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-18T03:16:16.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:15 trial114 ceph-mon[23907]: pgmap v55: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:16.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:15 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2254564786' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:16.375 INFO:teuthology.orchestra.run.trial097.stdout:51539607559 2026-02-18T03:16:16.375 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-18T03:16:16.380 INFO:teuthology.orchestra.run.trial097.stdout:34359738377 2026-02-18T03:16:16.381 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-18T03:16:16.403 INFO:teuthology.orchestra.run.trial097.stdout:94489280516 2026-02-18T03:16:16.404 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-18T03:16:16.416 INFO:teuthology.orchestra.run.trial097.stdout:68719476740 2026-02-18T03:16:16.416 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-18T03:16:16.492 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.530 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.575 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.577 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:16.731 INFO:teuthology.orchestra.run.trial097.stdout:51539607558 2026-02-18T03:16:16.747 INFO:teuthology.orchestra.run.trial097.stdout:34359738376 2026-02-18T03:16:16.777 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607559 got 51539607558 for osd.1 2026-02-18T03:16:16.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.0 2026-02-18T03:16:16.815 INFO:teuthology.orchestra.run.trial097.stdout:94489280514 2026-02-18T03:16:16.818 INFO:teuthology.orchestra.run.trial097.stdout:68719476739 2026-02-18T03:16:16.854 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280516 got 94489280514 for osd.3 2026-02-18T03:16:16.858 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476740 got 68719476739 for osd.2 2026-02-18T03:16:17.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3177861153' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:17.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2527403735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:16:17.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/406757248' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:16:17.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4176838340' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:16:17.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3525569768' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:16:17.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3177861153' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:17.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2527403735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:16:17.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/406757248' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:16:17.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4176838340' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:16:17.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3525569768' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:16:17.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3177861153' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:16:17.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2527403735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:16:17.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/406757248' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:16:17.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4176838340' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:16:17.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3525569768' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:16:17.778 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-18T03:16:17.786 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-18T03:16:17.855 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-18T03:16:17.859 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-18T03:16:17.897 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:17.939 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:17.981 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:17.987 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:18.054 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:17 trial097 ceph-mon[21799]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:18.144 INFO:teuthology.orchestra.run.trial097.stdout:51539607559 2026-02-18T03:16:18.162 INFO:teuthology.orchestra.run.trial097.stdout:34359738377 2026-02-18T03:16:18.187 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607559 got 51539607559 for osd.1 2026-02-18T03:16:18.187 DEBUG:teuthology.parallel:result is None 2026-02-18T03:16:18.201 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.0 2026-02-18T03:16:18.202 DEBUG:teuthology.parallel:result is None 2026-02-18T03:16:18.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:17 trial119 ceph-mon[24143]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:18.214 INFO:teuthology.orchestra.run.trial097.stdout:94489280516 2026-02-18T03:16:18.217 INFO:teuthology.orchestra.run.trial097.stdout:68719476741 2026-02-18T03:16:18.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:17 trial114 ceph-mon[23907]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:18.259 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476740 got 68719476741 for osd.2 2026-02-18T03:16:18.260 DEBUG:teuthology.parallel:result is None 2026-02-18T03:16:18.261 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.3 2026-02-18T03:16:18.261 DEBUG:teuthology.parallel:result is None 2026-02-18T03:16:18.261 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-18T03:16:18.261 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph pg dump --format=json 2026-02-18T03:16:18.416 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:18.639 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:18.639 INFO:teuthology.orchestra.run.trial097.stderr:dumped all 2026-02-18T03:16:18.674 INFO:teuthology.orchestra.run.trial097.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2026-02-18T03:16:17.409671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":45,"kb_used_meta":107730,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2094796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46838,"internal_metadata":110315786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000955"},"pg_stats":[{"pgid":"1.0","version":"18'152","reported_seq":209,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-18T03:16:13.915573+0000","last_change":"2026-02-18T03:16:13.915287+0000","last_active":"2026-02-18T03:16:13.915573+0000","last_peered":"2026-02-18T03:16:13.915573+0000","last_clean":"2026-02-18T03:16:13.915573+0000","last_became_active":"2026-02-18T03:16:13.914962+0000","last_became_peered":"2026-02-18T03:16:13.914962+0000","last_unstale":"2026-02-18T03:16:13.915573+0000","last_undegraded":"2026-02-18T03:16:13.915573+0000","last_fullsized":"2026-02-18T03:16:13.915573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:16:01.701228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:16:01.701228+0000","last_clean_scrub_stamp":"2026-02-18T03:16:01.701228+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:45:31.602603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":671291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":671291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607559,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":671291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":27577313},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":80923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":27574709},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T03:16:18.675 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph pg dump --format=json 2026-02-18T03:16:18.790 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:19.014 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:19.015 INFO:teuthology.orchestra.run.trial097.stderr:dumped all 2026-02-18T03:16:19.050 INFO:teuthology.orchestra.run.trial097.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2026-02-18T03:16:17.409671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":45,"kb_used_meta":107730,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2094796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46838,"internal_metadata":110315786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000955"},"pg_stats":[{"pgid":"1.0","version":"18'152","reported_seq":209,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-18T03:16:13.915573+0000","last_change":"2026-02-18T03:16:13.915287+0000","last_active":"2026-02-18T03:16:13.915573+0000","last_peered":"2026-02-18T03:16:13.915573+0000","last_clean":"2026-02-18T03:16:13.915573+0000","last_became_active":"2026-02-18T03:16:13.914962+0000","last_became_peered":"2026-02-18T03:16:13.914962+0000","last_unstale":"2026-02-18T03:16:13.915573+0000","last_undegraded":"2026-02-18T03:16:13.915573+0000","last_fullsized":"2026-02-18T03:16:13.915573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:16:01.701228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:16:01.701228+0000","last_clean_scrub_stamp":"2026-02-18T03:16:01.701228+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:45:31.602603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":671291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":671291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607559,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":671291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":27577313},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":80923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":27574709},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T03:16:19.051 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-18T03:16:19.051 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-18T03:16:19.051 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-18T03:16:19.052 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph health --format=json 2026-02-18T03:16:19.184 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:19.206 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/177111688' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:16:19.207 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3294067425' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:16:19.207 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3133662248' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:16:19.207 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1069593965' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:16:19.207 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:18 trial097 ceph-mon[21799]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:19.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/177111688' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:16:19.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3294067425' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:16:19.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3133662248' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:16:19.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1069593965' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:16:19.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:18 trial119 ceph-mon[24143]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:19.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/177111688' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:16:19.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3294067425' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:16:19.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3133662248' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:16:19.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1069593965' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:16:19.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:18 trial114 ceph-mon[23907]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:19.430 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:19.431 INFO:teuthology.orchestra.run.trial097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-18T03:16:19.467 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-18T03:16:19.467 INFO:tasks.cephadm:Setup complete, yielding 2026-02-18T03:16:19.468 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-18T03:16:19.483 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial097.front.sepia.ceph.com 2026-02-18T03:16:19.483 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-18T03:16:19.599 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:19.831 INFO:teuthology.orchestra.run.trial097.stdout:Backend: cephadm 2026-02-18T03:16:19.831 INFO:teuthology.orchestra.run.trial097.stdout:Available: Yes 2026-02-18T03:16:19.831 INFO:teuthology.orchestra.run.trial097.stdout:Paused: No 2026-02-18T03:16:19.869 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-18T03:16:19.986 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:20.099 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:19 trial097 ceph-mon[21799]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:20.099 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:19 trial097 ceph-mon[21799]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:20.099 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3207358888' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-18T03:16:20.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:19 trial119 ceph-mon[24143]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:20.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:19 trial119 ceph-mon[24143]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:20.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3207358888' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:mgr.x trial097 *:9283,8765 running (101s) 28s ago 101s 614M - 20.2.0-670-gadc19233 c2bc6184fe25 f177a67ef416 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:mon.a trial097 running (101s) 28s ago 102s 111M 2048M 20.2.0-670-gadc19233 c2bc6184fe25 02a2d25f1551 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:mon.b trial114 running (61s) 20s ago 61s 105M 2048M 20.2.0-670-gadc19233 c2bc6184fe25 8468313e987e 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:mon.c trial119 running (63s) 11s ago 62s 107M 2048M 20.2.0-670-gadc19233 c2bc6184fe25 2d3aae9268a5 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:osd.0 trial097 running (38s) 28s ago 40s 99.4M 82.0G 20.2.0-670-gadc19233 c2bc6184fe25 f4a848f67b25 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:osd.1 trial114 running (30s) 20s ago 32s 97.7M 86.0G 20.2.0-670-gadc19233 c2bc6184fe25 70a317e4252f 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:osd.2 trial119 running (22s) 11s ago 24s 107M 86.0G 20.2.0-670-gadc19233 c2bc6184fe25 9ab794098e5c 2026-02-18T03:16:20.217 INFO:teuthology.orchestra.run.trial097.stdout:osd.3 trial194 running (13s) 11s ago 15s 95.5M 87.0G 20.2.0-670-gadc19233 c2bc6184fe25 a64ff5540275 2026-02-18T03:16:20.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:19 trial114 ceph-mon[23907]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:20.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:19 trial114 ceph-mon[23907]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:20.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3207358888' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-18T03:16:20.254 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-18T03:16:20.369 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:20.598 INFO:teuthology.orchestra.run.trial097.stdout:HOST ADDR LABELS STATUS 2026-02-18T03:16:20.598 INFO:teuthology.orchestra.run.trial097.stdout:trial031 10.20.193.31 2026-02-18T03:16:20.598 INFO:teuthology.orchestra.run.trial097.stdout:trial078 10.20.193.78 2026-02-18T03:16:20.599 INFO:teuthology.orchestra.run.trial097.stdout:trial097 10.20.193.97 2026-02-18T03:16:20.599 INFO:teuthology.orchestra.run.trial097.stdout:trial114 10.20.193.114 2026-02-18T03:16:20.599 INFO:teuthology.orchestra.run.trial097.stdout:trial119 10.20.193.119 2026-02-18T03:16:20.599 INFO:teuthology.orchestra.run.trial097.stdout:trial194 10.20.193.194 2026-02-18T03:16:20.599 INFO:teuthology.orchestra.run.trial097.stdout:6 hosts in cluster 2026-02-18T03:16:20.634 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-18T03:16:20.750 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:20.980 INFO:teuthology.orchestra.run.trial097.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-18T03:16:20.980 INFO:teuthology.orchestra.run.trial097.stdout:trial031 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB5195 1788G No 74s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial031 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB516F 1788G No 74s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial078 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00120 1788G No 72s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial078 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B000E6 1788G No 72s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial097 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6BAA 1788G No 28s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial097 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6B8E 1788G No 28s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial114 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6E8A 1788G No 20s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial114 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6E9F 1788G No 20s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial119 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6E45 1788G No 11s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial119 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6DCB 1788G No 11s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.981 INFO:teuthology.orchestra.run.trial097.stdout:trial194 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47DBD 1788G No 11s ago Has a FileSystem, LVM detected 2026-02-18T03:16:20.982 INFO:teuthology.orchestra.run.trial097.stdout:trial194 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47E26 1788G No 11s ago Has a FileSystem, LVM detected 2026-02-18T03:16:21.018 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- bash -c 'ceph osd lspools' 2026-02-18T03:16:21.134 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:21.185 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:20 trial097 ceph-mon[21799]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.185 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:20 trial097 ceph-mon[21799]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.185 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:20 trial097 ceph-mon[21799]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:20 trial119 ceph-mon[24143]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:20 trial119 ceph-mon[24143]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:20 trial119 ceph-mon[24143]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:20 trial114 ceph-mon[23907]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:20 trial114 ceph-mon[23907]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:20 trial114 ceph-mon[23907]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:21.362 INFO:teuthology.orchestra.run.trial097.stdout:1 .mgr 2026-02-18T03:16:21.398 INFO:teuthology.run_tasks:Running task nvmeof... 2026-02-18T03:16:21.430 INFO:tasks.nvmeof:[nvmeof]: deploying nvmeof gateway... 2026-02-18T03:16:21.430 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.a on trial097 2026-02-18T03:16:21.431 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.b on trial114 2026-02-18T03:16:21.431 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.c on trial119 2026-02-18T03:16:21.431 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.d on trial194 2026-02-18T03:16:21.431 INFO:tasks.nvmeof:[nvmeof]: ceph config set mgr mgr/cephadm/container_image_nvmeof quay.io/ceph/nvmeof:devel 2026-02-18T03:16:21.431 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph config set mgr mgr/cephadm/container_image_nvmeof quay.io/ceph/nvmeof:devel 2026-02-18T03:16:21.546 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:21.811 INFO:tasks.nvmeof:[nvmeof]: ceph osd pool create mypool 2026-02-18T03:16:21.812 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph osd pool create mypool 2026-02-18T03:16:21.928 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:22.043 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:21 trial097 ceph-mon[21799]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:22.043 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:21 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3933957071' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2026-02-18T03:16:22.043 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:21 trial097 ceph-mon[21799]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:22.043 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:21 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4155581510' entity='client.admin' 2026-02-18T03:16:22.043 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:21 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:22.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:21 trial119 ceph-mon[24143]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:22.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:21 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3933957071' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2026-02-18T03:16:22.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:21 trial119 ceph-mon[24143]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:22.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:21 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4155581510' entity='client.admin' 2026-02-18T03:16:22.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:21 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:22.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:21 trial114 ceph-mon[23907]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:22.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:21 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3933957071' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2026-02-18T03:16:22.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:21 trial114 ceph-mon[23907]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:22.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:21 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4155581510' entity='client.admin' 2026-02-18T03:16:22.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:21 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:23.106 INFO:teuthology.orchestra.run.trial097.stderr:pool 'mypool' created 2026-02-18T03:16:23.146 INFO:tasks.nvmeof:[nvmeof]: rbd pool init mypool 2026-02-18T03:16:23.147 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- rbd pool init mypool 2026-02-18T03:16:23.261 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:23.375 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.376 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.376 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/933337397' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2026-02-18T03:16:23.376 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.376 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.376 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:23.376 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:23.376 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.376 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:23 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:23.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/933337397' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2026-02-18T03:16:23.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:23.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:23.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:23 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/933337397' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:23.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:23 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:24.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/933337397' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2026-02-18T03:16:24.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:24 trial097 ceph-mon[21799]: osdmap e27: 4 total, 4 up, 4 in 2026-02-18T03:16:24.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1241336581' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2026-02-18T03:16:24.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:24 trial097 ceph-mon[21799]: pgmap v60: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:24.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/933337397' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2026-02-18T03:16:24.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:24 trial119 ceph-mon[24143]: osdmap e27: 4 total, 4 up, 4 in 2026-02-18T03:16:24.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1241336581' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2026-02-18T03:16:24.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:24 trial119 ceph-mon[24143]: pgmap v60: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:24.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/933337397' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2026-02-18T03:16:24.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:24 trial114 ceph-mon[23907]: osdmap e27: 4 total, 4 up, 4 in 2026-02-18T03:16:24.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1241336581' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2026-02-18T03:16:24.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:24 trial114 ceph-mon[23907]: pgmap v60: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:25.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:25 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1241336581' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2026-02-18T03:16:25.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:25 trial097 ceph-mon[21799]: osdmap e28: 4 total, 4 up, 4 in 2026-02-18T03:16:25.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:25 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1241336581' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2026-02-18T03:16:25.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:25 trial119 ceph-mon[24143]: osdmap e28: 4 total, 4 up, 4 in 2026-02-18T03:16:25.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:25 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1241336581' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2026-02-18T03:16:25.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:25 trial114 ceph-mon[23907]: osdmap e28: 4 total, 4 up, 4 in 2026-02-18T03:16:26.155 INFO:tasks.nvmeof:[nvmeof]: ceph orch apply nvmeof mypool mygroup0 2026-02-18T03:16:26.155 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch apply nvmeof mypool mygroup0 --placement 'trial097=nvmeof.a;trial114=nvmeof.b;trial119=nvmeof.c;trial194=nvmeof.d' 2026-02-18T03:16:26.271 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:26.386 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:26 trial097 ceph-mon[21799]: osdmap e29: 4 total, 4 up, 4 in 2026-02-18T03:16:26.387 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:26 trial097 ceph-mon[21799]: pgmap v63: 33 pgs: 7 creating+peering, 18 unknown, 8 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:26.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:26 trial119 ceph-mon[24143]: osdmap e29: 4 total, 4 up, 4 in 2026-02-18T03:16:26.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:26 trial119 ceph-mon[24143]: pgmap v63: 33 pgs: 7 creating+peering, 18 unknown, 8 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:26.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:26 trial114 ceph-mon[23907]: osdmap e29: 4 total, 4 up, 4 in 2026-02-18T03:16:26.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:26 trial114 ceph-mon[23907]: pgmap v63: 33 pgs: 7 creating+peering, 18 unknown, 8 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:26.511 INFO:teuthology.orchestra.run.trial097.stdout:Scheduled nvmeof.mypool.mygroup0 update... 2026-02-18T03:16:26.550 INFO:tasks.nvmeof:[nvmeof]: creating 60 images 2026-02-18T03:16:26.551 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- rbd create mypool/myimage1 --size 8192 ; rbd create mypool/myimage2 --size 8192 ; rbd create mypool/myimage3 --size 8192 ; rbd create mypool/myimage4 --size 8192 ; rbd create mypool/myimage5 --size 8192 ; rbd create mypool/myimage6 --size 8192 ; rbd create mypool/myimage7 --size 8192 ; rbd create mypool/myimage8 --size 8192 ; rbd create mypool/myimage9 --size 8192 ; rbd create mypool/myimage10 --size 8192 ; rbd create mypool/myimage11 --size 8192 ; rbd create mypool/myimage12 --size 8192 ; rbd create mypool/myimage13 --size 8192 ; rbd create mypool/myimage14 --size 8192 ; rbd create mypool/myimage15 --size 8192 ; rbd create mypool/myimage16 --size 8192 ; rbd create mypool/myimage17 --size 8192 ; rbd create mypool/myimage18 --size 8192 ; rbd create mypool/myimage19 --size 8192 ; rbd create mypool/myimage20 --size 8192 ; rbd create mypool/myimage21 --size 8192 ; rbd create mypool/myimage22 --size 8192 ; rbd create mypool/myimage23 --size 8192 ; rbd create mypool/myimage24 --size 8192 ; rbd create mypool/myimage25 --size 8192 ; rbd create mypool/myimage26 --size 8192 ; rbd create mypool/myimage27 --size 8192 ; rbd create mypool/myimage28 --size 8192 ; rbd create mypool/myimage29 --size 8192 ; rbd create mypool/myimage30 --size 8192 ; rbd create mypool/myimage31 --size 8192 ; rbd create mypool/myimage32 --size 8192 ; rbd create mypool/myimage33 --size 8192 ; rbd create mypool/myimage34 --size 8192 ; rbd create mypool/myimage35 --size 8192 ; rbd create mypool/myimage36 --size 8192 ; rbd create mypool/myimage37 --size 8192 ; rbd create mypool/myimage38 --size 8192 ; rbd create mypool/myimage39 --size 8192 ; rbd create mypool/myimage40 --size 8192 ; rbd create mypool/myimage41 --size 8192 ; rbd create mypool/myimage42 --size 8192 ; rbd create mypool/myimage43 --size 8192 ; rbd create mypool/myimage44 --size 8192 ; rbd create mypool/myimage45 --size 8192 ; rbd create mypool/myimage46 --size 8192 ; rbd create mypool/myimage47 --size 8192 ; rbd create mypool/myimage48 --size 8192 ; rbd create mypool/myimage49 --size 8192 ; rbd create mypool/myimage50 --size 8192 ; rbd create mypool/myimage51 --size 8192 ; rbd create mypool/myimage52 --size 8192 ; rbd create mypool/myimage53 --size 8192 ; rbd create mypool/myimage54 --size 8192 ; rbd create mypool/myimage55 --size 8192 ; rbd create mypool/myimage56 --size 8192 ; rbd create mypool/myimage57 --size 8192 ; rbd create mypool/myimage58 --size 8192 ; rbd create mypool/myimage59 --size 8192 ; rbd create mypool/myimage60 --size 8192 ; 2026-02-18T03:16:26.667 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:27.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: osdmap e30: 4 total, 4 up, 4 in 2026-02-18T03:16:27.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "group": "mygroup0", "placement": "trial097=nvmeof.a;trial114=nvmeof.b;trial119=nvmeof.c;trial194=nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:27.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:16:27.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: Saving service nvmeof.mypool.mygroup0 spec with placement trial097=nvmeof.a;trial114=nvmeof.b;trial119=nvmeof.c;trial194=nvmeof.d 2026-02-18T03:16:27.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:27.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:27.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:27.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:27.406 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:27.406 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:27.406 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:27.406 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:27.406 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: gateway address: 10.20.193.114 from map_addr=None spec.addr=None host_ip='10.20.193.114' 2026-02-18T03:16:27.406 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: discovery address: 10.20.193.114 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.114' 2026-02-18T03:16:27.406 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:27.406 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:27 trial097 ceph-mon[21799]: Deploying daemon nvmeof.nvmeof.b on trial114 2026-02-18T03:16:27.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: osdmap e30: 4 total, 4 up, 4 in 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "group": "mygroup0", "placement": "trial097=nvmeof.a;trial114=nvmeof.b;trial119=nvmeof.c;trial194=nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: Saving service nvmeof.mypool.mygroup0 spec with placement trial097=nvmeof.a;trial114=nvmeof.b;trial119=nvmeof.c;trial194=nvmeof.d 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:27.464 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:27.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:27.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: gateway address: 10.20.193.114 from map_addr=None spec.addr=None host_ip='10.20.193.114' 2026-02-18T03:16:27.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: discovery address: 10.20.193.114 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.114' 2026-02-18T03:16:27.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:27.465 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:27 trial119 ceph-mon[24143]: Deploying daemon nvmeof.nvmeof.b on trial114 2026-02-18T03:16:27.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: osdmap e30: 4 total, 4 up, 4 in 2026-02-18T03:16:27.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "group": "mygroup0", "placement": "trial097=nvmeof.a;trial114=nvmeof.b;trial119=nvmeof.c;trial194=nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:27.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:16:27.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: Saving service nvmeof.mypool.mygroup0 spec with placement trial097=nvmeof.a;trial114=nvmeof.b;trial119=nvmeof.c;trial194=nvmeof.d 2026-02-18T03:16:27.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:27.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:27.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:27.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:27.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:27.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:27.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:27.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:27.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: gateway address: 10.20.193.114 from map_addr=None spec.addr=None host_ip='10.20.193.114' 2026-02-18T03:16:27.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: discovery address: 10.20.193.114 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.114' 2026-02-18T03:16:27.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:27.475 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:27 trial114 ceph-mon[23907]: Deploying daemon nvmeof.nvmeof.b on trial114 2026-02-18T03:16:28.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:28 trial114 ceph-mon[23907]: pgmap v65: 33 pgs: 7 creating+peering, 26 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:28.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:28 trial097 ceph-mon[21799]: pgmap v65: 33 pgs: 7 creating+peering, 26 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:28.424 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls nvmeof --export > /etc/ceph/nvmeof-gw.yaml 2026-02-18T03:16:28.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:28 trial119 ceph-mon[24143]: pgmap v65: 33 pgs: 7 creating+peering, 26 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:28.542 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:28.812 DEBUG:teuthology.orchestra.run.trial097:nvmeof.nvmeof.a> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:16:28.814 DEBUG:teuthology.orchestra.run.trial114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls nvmeof --export > /etc/ceph/nvmeof-gw.yaml 2026-02-18T03:16:28.947 INFO:teuthology.orchestra.run.trial114.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.b/config 2026-02-18T03:16:29.249 DEBUG:teuthology.orchestra.run.trial114:nvmeof.nvmeof.b> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:16:29.252 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls nvmeof --export > /etc/ceph/nvmeof-gw.yaml 2026-02-18T03:16:29.371 INFO:teuthology.orchestra.run.trial119.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.c/config 2026-02-18T03:16:29.393 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:29 trial119 ceph-mon[24143]: mgrmap e15: x(active, since 90s) 2026-02-18T03:16:29.403 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:29 trial097 ceph-mon[21799]: mgrmap e15: x(active, since 90s) 2026-02-18T03:16:29.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:29 trial114 ceph-mon[23907]: mgrmap e15: x(active, since 90s) 2026-02-18T03:16:29.669 DEBUG:teuthology.orchestra.run.trial119:nvmeof.nvmeof.c> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:16:29.671 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls nvmeof --export > /etc/ceph/nvmeof-gw.yaml 2026-02-18T03:16:29.791 INFO:teuthology.orchestra.run.trial194.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/config/ceph.conf 2026-02-18T03:16:30.078 DEBUG:teuthology.orchestra.run.trial194:nvmeof.nvmeof.d> sudo journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:16:30.081 INFO:tasks.nvmeof:[nvmeof]: executed deploy_nvmeof successfully! 2026-02-18T03:16:30.081 INFO:tasks.nvmeof:[nvmeof]: running set_gateway_cfg... 2026-02-18T03:16:30.082 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:16:30.082 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:16:30.109 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:16:30.109 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:16:30.135 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-18T03:16:30.135 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:16:30.160 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-18T03:16:30.160 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:16:30.186 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-18T03:16:30.186 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:16:30.213 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-18T03:16:30.213 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:16:30.240 INFO:tasks.nvmeof:[nvmeof]: executed set_gateway_cfg successfully! 2026-02-18T03:16:30.240 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2026-02-18T03:16:30.256 INFO:tasks.cephadm:Waiting for ceph service nvmeof.mypool.mygroup0 to start (timeout 300)... 2026-02-18T03:16:30.257 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:30.374 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:30.397 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:30 trial097 ceph-mon[21799]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.397 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:30 trial097 ceph-mon[21799]: from='client.24665 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.397 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:30 trial097 ceph-mon[21799]: pgmap v66: 33 pgs: 33 active+clean; 585 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 21 KiB/s rd, 8.0 KiB/s wr, 37 op/s 2026-02-18T03:16:30.397 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:30 trial097 ceph-mon[21799]: from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:30 trial119 ceph-mon[24143]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:30 trial119 ceph-mon[24143]: from='client.24665 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:30 trial119 ceph-mon[24143]: pgmap v66: 33 pgs: 33 active+clean; 585 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 21 KiB/s rd, 8.0 KiB/s wr, 37 op/s 2026-02-18T03:16:30.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:30 trial119 ceph-mon[24143]: from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:30 trial114 ceph-mon[23907]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:30 trial114 ceph-mon[23907]: from='client.24665 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:30 trial114 ceph-mon[23907]: pgmap v66: 33 pgs: 33 active+clean; 585 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 21 KiB/s rd, 8.0 KiB/s wr, 37 op/s 2026-02-18T03:16:30.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:30 trial114 ceph-mon[23907]: from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:30.610 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:30.610 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:26.510774Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:30.649 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:31.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:31 trial097 ceph-mon[21799]: from='client.24674 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:31.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:31 trial097 ceph-mon[21799]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:31.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:31 trial119 ceph-mon[24143]: from='client.24674 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:31.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:31 trial119 ceph-mon[24143]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:31.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:31 trial114 ceph-mon[23907]: from='client.24674 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:16:31.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:31 trial114 ceph-mon[23907]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:31.650 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:31.768 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:31.997 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:31.997 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:26.510774Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:32.036 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:32.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:32 trial097 ceph-mon[21799]: pgmap v67: 33 pgs: 33 active+clean; 600 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 56 op/s 2026-02-18T03:16:32.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:32 trial119 ceph-mon[24143]: pgmap v67: 33 pgs: 33 active+clean; 600 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 56 op/s 2026-02-18T03:16:32.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:32 trial114 ceph-mon[23907]: pgmap v67: 33 pgs: 33 active+clean; 600 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 56 op/s 2026-02-18T03:16:33.037 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:33.155 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:33.386 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:33.386 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:26.510774Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:33.387 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:33 trial097 ceph-mon[21799]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:33.424 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:33.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:33 trial119 ceph-mon[24143]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:33.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:33 trial114 ceph-mon[23907]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:34.425 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:34.544 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:34.705 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:34.705 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: pgmap v68: 33 pgs: 33 active+clean; 609 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 36 KiB/s rd, 29 KiB/s wr, 86 op/s 2026-02-18T03:16:34.705 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: osdmap e31: 4 total, 4 up, 4 in 2026-02-18T03:16:34.705 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.705 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.705 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.706 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:34.706 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:34.706 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:34.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 bash[33547]: Copying config sha256:99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 2026-02-18T03:16:34.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 bash[33547]: Writing manifest to image destination 2026-02-18T03:16:34.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 podman[33547]: 2026-02-18 03:16:34.490199901 +0000 UTC m=+7.431391998 container create 5cb12fb2318577711ea0f0218d4e9fd455c067db2f567ab3322d32fb29c67717 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.maintainer=Ceph Developers , io.spdk.git.repo=https://github.com/ceph/spdk.git, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.component=ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, build-date=2026-02-11 09:53:49 UTC, architecture=x86_64, release=, io.ceph.nvmeof=, version=1.6.5, vcs-type=git, io.spdk.git.branch=undefined, url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.version=1.6.5, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vendor=Red Hat, Inc., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.component=ubi9-container, io.ceph.git.branch=devel, org.centos.version=9.0-30.el9, io.openshift.wants=ceph,rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.target-arch=x86-64-v2, maintainer=Ceph Developers ) 2026-02-18T03:16:34.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 podman[33547]: 2026-02-18 03:16:34.524457629 +0000 UTC m=+7.465649726 container init 5cb12fb2318577711ea0f0218d4e9fd455c067db2f567ab3322d32fb29c67717 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.version=25.09, distribution-scope=public, maintainer=Ceph Developers , io.spdk.build.makeflags=, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, io.spdk.build.ceph-release=20.2.0, io.ceph.git.branch=devel, io.spdk.git.branch=undefined, io.spdk.build.target-arch=x86-64-v2, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.pkgdep-args=--rbd, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, architecture=x86_64, io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, name=ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.maintainer=Ceph Developers , io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-type=git, io.ceph.nvmeof=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-30.el9, release=, io.ceph.version=1.6.5, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, build-date=2026-02-11 09:53:49 UTC, version=1.6.5, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof) 2026-02-18T03:16:34.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 podman[33547]: 2026-02-18 03:16:34.526817959 +0000 UTC m=+7.468010066 container start 5cb12fb2318577711ea0f0218d4e9fd455c067db2f567ab3322d32fb29c67717 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, architecture=x86_64, com.redhat.component=ubi9-container, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, maintainer=Ceph Developers , io.ceph.maintainer=Ceph Developers , vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, io.spdk.build.makeflags=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, release=, url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, io.buildah.version=1.29.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.branch=undefined, io.ceph.nvmeof=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, distribution-scope=public, version=1.6.5, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.ceph-release=20.2.0, io.ceph.git.branch=devel, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, summary=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, name=ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, build-date=2026-02-11 09:53:49 UTC, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T03:16:34.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 bash[33547]: 5cb12fb2318577711ea0f0218d4e9fd455c067db2f567ab3322d32fb29c67717 2026-02-18T03:16:34.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 podman[33547]: 2026-02-18 03:16:34.484100315 +0000 UTC m=+7.425292412 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:16:34.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 systemd[1]: Started Ceph nvmeof.nvmeof.b for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:16:34.777 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:34.777 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:34.577092Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: pgmap v68: 33 pgs: 33 active+clean; 609 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 36 KiB/s rd, 29 KiB/s wr, 86 op/s 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: osdmap e31: 4 total, 4 up, 4 in 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:34.778 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:34 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:34.813 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: pgmap v68: 33 pgs: 33 active+clean; 609 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 36 KiB/s rd, 29 KiB/s wr, 86 op/s 2026-02-18T03:16:34.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: osdmap e31: 4 total, 4 up, 4 in 2026-02-18T03:16:34.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:34.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:34.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:34.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:34 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:16:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b, using rotation 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:16:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): [gateway] 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): name = client.nvmeof.nvmeof.b 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): addr = 10.20.193.114 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): port = 5500 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:16:34.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:16:34.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:16:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:16:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): force_tls = False 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:16:34.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:16:34.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:16:34.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): [discovery] 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): addr = 10.20.193.114 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): port = 8009 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:16:34.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): [ceph] 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): pool = mypool 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): id = nvmeof.nvmeof.b 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): [mtls] 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): 2026-02-18T03:16:34.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): [spdk] 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): transports = tcp 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:16:34.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): [monitor] 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.b 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO state.py:891 (2): First gateway: created object nvmeof.mygroup0.state 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.114:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.114:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:16:34.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:16:34.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:34] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.114:5499 for group id 2026-02-18T03:16:35.380 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Getting image source signatures 2026-02-18T03:16:35.380 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Copying blob sha256:e1ad571dfbd92db00152ab9cd6103ce1496b77b702f05f6f8a3c34f35c60b2c9 2026-02-18T03:16:35.380 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Copying blob sha256:3c74c9b146a29bfada03feb9fb249c05e0ba7dfa7a35ef659d40b403a3638baa 2026-02-18T03:16:35.380 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2026-02-18T03:16:35.380 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Copying blob sha256:9bc0f775acafdf3d8cec026216b4d1af8405c4383413c5488232c22180fc440b 2026-02-18T03:16:35.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Copying blob sha256:c1222dc7ae510c1747954c83b2d87b79c1f7ad23a782e560bce90c2fb40fc391 2026-02-18T03:16:35.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Copying blob sha256:8d5bd62c11c679d096279fd5d8ef3c429c0843067310e0c75a0fb3a7a6bc56e5 2026-02-18T03:16:35.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Copying blob sha256:a7ffbc3af914b27a37e5a4bc0d1c4d4b85c7040f0ab0e4de4023ae4bdca097b3 2026-02-18T03:16:35.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:35 trial194 bash[34923]: Copying blob sha256:28334eab29c252fcb610de92adc0b20cbad462a56beba9241601f27496857eda 2026-02-18T03:16:35.813 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:35.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:35 trial097 ceph-mon[21799]: gateway address: 10.20.193.194 from map_addr=None spec.addr=None host_ip='10.20.193.194' 2026-02-18T03:16:35.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:35 trial097 ceph-mon[21799]: discovery address: 10.20.193.194 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.194' 2026-02-18T03:16:35.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:35 trial097 ceph-mon[21799]: Deploying daemon nvmeof.nvmeof.d on trial194 2026-02-18T03:16:35.932 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:35.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:35 trial119 ceph-mon[24143]: gateway address: 10.20.193.194 from map_addr=None spec.addr=None host_ip='10.20.193.194' 2026-02-18T03:16:35.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:35 trial119 ceph-mon[24143]: discovery address: 10.20.193.194 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.194' 2026-02-18T03:16:35.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:35 trial119 ceph-mon[24143]: Deploying daemon nvmeof.nvmeof.d on trial194 2026-02-18T03:16:35.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:35 trial114 ceph-mon[23907]: gateway address: 10.20.193.194 from map_addr=None spec.addr=None host_ip='10.20.193.194' 2026-02-18T03:16:35.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:35 trial114 ceph-mon[23907]: discovery address: 10.20.193.194 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.194' 2026-02-18T03:16:35.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:35 trial114 ceph-mon[23907]: Deploying daemon nvmeof.nvmeof.d on trial194 2026-02-18T03:16:36.162 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:36.162 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:34.577092Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:36.199 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:36.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:36 trial097 ceph-mon[21799]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:36.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:36 trial097 ceph-mon[21799]: pgmap v70: 33 pgs: 33 active+clean; 609 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 77 op/s 2026-02-18T03:16:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:36 trial119 ceph-mon[24143]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:36 trial119 ceph-mon[24143]: pgmap v70: 33 pgs: 33 active+clean; 609 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 77 op/s 2026-02-18T03:16:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:36 trial114 ceph-mon[23907]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:36.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:36 trial114 ceph-mon[23907]: pgmap v70: 33 pgs: 33 active+clean; 609 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 77 op/s 2026-02-18T03:16:37.200 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:37.321 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:37.551 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:37.551 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:34.577092Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:37.588 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:37.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:37 trial097 ceph-mon[21799]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:37.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:37 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:37.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:37 trial119 ceph-mon[24143]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:37.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:37 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:37.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:37 trial114 ceph-mon[23907]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:37.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:37 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:38.588 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:38.706 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:38.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:38 trial097 ceph-mon[21799]: pgmap v71: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 30 KiB/s rd, 24 KiB/s wr, 72 op/s 2026-02-18T03:16:38.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:38 trial097 ceph-mon[21799]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:38.940 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:38.940 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:34.577092Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:38 trial119 ceph-mon[24143]: pgmap v71: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 30 KiB/s rd, 24 KiB/s wr, 72 op/s 2026-02-18T03:16:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:38 trial119 ceph-mon[24143]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:38 trial114 ceph-mon[23907]: pgmap v71: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 30 KiB/s rd, 24 KiB/s wr, 72 op/s 2026-02-18T03:16:38.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:38 trial114 ceph-mon[23907]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:38.977 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:39.978 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:40.094 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:40.320 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:40.321 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:34.577092Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:40.358 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:40.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:40 trial097 ceph-mon[21799]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:40.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:40 trial097 ceph-mon[21799]: pgmap v72: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 49 op/s 2026-02-18T03:16:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:40 trial119 ceph-mon[24143]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:40 trial119 ceph-mon[24143]: pgmap v72: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 49 op/s 2026-02-18T03:16:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:40 trial114 ceph-mon[23907]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:40 trial114 ceph-mon[23907]: pgmap v72: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 49 op/s 2026-02-18T03:16:41.359 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:41.477 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:41.654 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:41 trial097 ceph-mon[21799]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:41.712 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:41.712 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:34.577092Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:41.750 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:41.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:41 trial119 ceph-mon[24143]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:41.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:41 trial114 ceph-mon[23907]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:42.752 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:42.871 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:42.893 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:42 trial097 ceph-mon[21799]: pgmap v73: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 31 op/s 2026-02-18T03:16:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:42 trial119 ceph-mon[24143]: pgmap v73: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 31 op/s 2026-02-18T03:16:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:42 trial114 ceph-mon[23907]: pgmap v73: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 31 op/s 2026-02-18T03:16:43.101 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:43.102 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:43.086819Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:43.140 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:43.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:42 trial194 bash[34923]: Copying config sha256:99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 2026-02-18T03:16:43.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:42 trial194 bash[34923]: Writing manifest to image destination 2026-02-18T03:16:43.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:42 trial194 podman[34923]: 2026-02-18 03:16:42.998680213 +0000 UTC m=+7.887372421 container create 2559778aa6b444047a7d6119aba21fae98081a7757f4b3bb082e157bc55aa954 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, architecture=x86_64, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.target-arch=x86-64-v2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.branch=devel, vendor=Red Hat, Inc., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.ceph.component=ceph-nvmeof, io.ceph.maintainer=Ceph Developers , io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.branch=undefined, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-type=git, maintainer=Ceph Developers , io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.nvmeof=, io.spdk.build.makeflags=, com.redhat.component=ubi9-container, distribution-scope=public, version=1.6.5, name=ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, release=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.version=25.09, io.spdk.build.ceph-release=20.2.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, summary=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, build-date=2026-02-11 09:53:49 UTC, org.centos.version=9.0-30.el9) 2026-02-18T03:16:43.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 podman[34923]: 2026-02-18 03:16:42.992414177 +0000 UTC m=+7.881106385 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:16:43.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 podman[34923]: 2026-02-18 03:16:43.038003971 +0000 UTC m=+7.926696179 container init 2559778aa6b444047a7d6119aba21fae98081a7757f4b3bb082e157bc55aa954 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d, io.buildah.version=1.29.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vendor=Red Hat, Inc., version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , build-date=2026-02-11 09:53:49 UTC, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.git.repo=https://github.com/ceph/spdk.git, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, org.centos.version=9.0-30.el9, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.branch=undefined, io.ceph.nvmeof=, architecture=x86_64, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., release=, io.spdk.build.makeflags=, io.spdk.build.ceph-release=20.2.0, io.ceph.version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, vcs-type=git, maintainer=Ceph Developers , io.spdk.build.target-arch=x86-64-v2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, io.spdk.version=25.09, io.spdk.build.pkgdep-args=--rbd, url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:16:43.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 podman[34923]: 2026-02-18 03:16:43.040598176 +0000 UTC m=+7.929290394 container start 2559778aa6b444047a7d6119aba21fae98081a7757f4b3bb082e157bc55aa954 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, org.centos.version=9.0-30.el9, com.redhat.component=ubi9-container, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=undefined, summary=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, io.ceph.nvmeof=, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, version=1.6.5, io.ceph.component=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-type=git, io.spdk.build.ceph-release=20.2.0, vendor=Red Hat, Inc., io.ceph.version=1.6.5, release=, io.spdk.version=25.09, io.ceph.maintainer=Ceph Developers , maintainer=Ceph Developers , distribution-scope=public, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.target-arch=x86-64-v2, io.buildah.version=1.29.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, build-date=2026-02-11 09:53:49 UTC, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom) 2026-02-18T03:16:43.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 bash[34923]: 2559778aa6b444047a7d6119aba21fae98081a7757f4b3bb082e157bc55aa954 2026-02-18T03:16:43.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 systemd[1]: Started Ceph nvmeof.nvmeof.d for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:16:43.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:16:43.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d, using rotation 2026-02-18T03:16:43.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:16:43.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:16:43.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:16:43.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): [gateway] 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): name = client.nvmeof.nvmeof.d 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): addr = 10.20.193.194 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): port = 5500 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:16:43.634 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:16:43.635 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:43.636 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:16:43.637 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): force_tls = False 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): 2026-02-18T03:16:43.638 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:16:43.639 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:16:43.639 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:16:43.639 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:16:43.639 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): [discovery] 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): addr = 10.20.193.194 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): port = 8009 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): 2026-02-18T03:16:43.640 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): [ceph] 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): pool = mypool 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): id = nvmeof.nvmeof.d 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): [mtls] 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): [spdk] 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): transports = tcp 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): [monitor] 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.d 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.194:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.194:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:16:43.641 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:43] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.194:5499 for group id 2026-02-18T03:16:43.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:43 trial097 ceph-mon[21799]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:43.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:43.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:43.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:43 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:43 trial119 ceph-mon[24143]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:43 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:43.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:43 trial119 bash[34248]: Trying to pull quay.io/ceph/nvmeof:devel... 2026-02-18T03:16:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:43 trial114 ceph-mon[23907]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:43 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:44.141 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:44.259 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Getting image source signatures 2026-02-18T03:16:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Copying blob sha256:e1ad571dfbd92db00152ab9cd6103ce1496b77b702f05f6f8a3c34f35c60b2c9 2026-02-18T03:16:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Copying blob sha256:3c74c9b146a29bfada03feb9fb249c05e0ba7dfa7a35ef659d40b403a3638baa 2026-02-18T03:16:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2026-02-18T03:16:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Copying blob sha256:9bc0f775acafdf3d8cec026216b4d1af8405c4383413c5488232c22180fc440b 2026-02-18T03:16:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Copying blob sha256:c1222dc7ae510c1747954c83b2d87b79c1f7ad23a782e560bce90c2fb40fc391 2026-02-18T03:16:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Copying blob sha256:8d5bd62c11c679d096279fd5d8ef3c429c0843067310e0c75a0fb3a7a6bc56e5 2026-02-18T03:16:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Copying blob sha256:a7ffbc3af914b27a37e5a4bc0d1c4d4b85c7040f0ab0e4de4023ae4bdca097b3 2026-02-18T03:16:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:44 trial119 bash[34248]: Copying blob sha256:28334eab29c252fcb610de92adc0b20cbad462a56beba9241601f27496857eda 2026-02-18T03:16:44.494 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:44.494 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:43.086819Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:44.531 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:44 trial097 ceph-mon[21799]: gateway address: 10.20.193.119 from map_addr=None spec.addr=None host_ip='10.20.193.119' 2026-02-18T03:16:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:44 trial097 ceph-mon[21799]: discovery address: 10.20.193.119 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.119' 2026-02-18T03:16:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:44 trial097 ceph-mon[21799]: Deploying daemon nvmeof.nvmeof.c on trial119 2026-02-18T03:16:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:44 trial097 ceph-mon[21799]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:44.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:44 trial097 ceph-mon[21799]: pgmap v74: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s wr, 0 op/s 2026-02-18T03:16:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:44 trial119 ceph-mon[24143]: gateway address: 10.20.193.119 from map_addr=None spec.addr=None host_ip='10.20.193.119' 2026-02-18T03:16:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:44 trial119 ceph-mon[24143]: discovery address: 10.20.193.119 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.119' 2026-02-18T03:16:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:44 trial119 ceph-mon[24143]: Deploying daemon nvmeof.nvmeof.c on trial119 2026-02-18T03:16:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:44 trial119 ceph-mon[24143]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:44 trial119 ceph-mon[24143]: pgmap v74: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s wr, 0 op/s 2026-02-18T03:16:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:44 trial114 ceph-mon[23907]: gateway address: 10.20.193.119 from map_addr=None spec.addr=None host_ip='10.20.193.119' 2026-02-18T03:16:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:44 trial114 ceph-mon[23907]: discovery address: 10.20.193.119 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.119' 2026-02-18T03:16:44.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:44 trial114 ceph-mon[23907]: Deploying daemon nvmeof.nvmeof.c on trial119 2026-02-18T03:16:44.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:44 trial114 ceph-mon[23907]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:44.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:44 trial114 ceph-mon[23907]: pgmap v74: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s wr, 0 op/s 2026-02-18T03:16:45.532 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:45.651 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:45.878 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:45.879 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:43.086819Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:45.879 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:45 trial097 ceph-mon[21799]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:45.915 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:45 trial119 ceph-mon[24143]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:45.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:45 trial114 ceph-mon[23907]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:46.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:46 trial097 ceph-mon[21799]: pgmap v75: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 86 B/s wr, 0 op/s 2026-02-18T03:16:46.916 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:46 trial119 ceph-mon[24143]: pgmap v75: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 86 B/s wr, 0 op/s 2026-02-18T03:16:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:46 trial114 ceph-mon[23907]: pgmap v75: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 86 B/s wr, 0 op/s 2026-02-18T03:16:47.037 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:47.272 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:47.272 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:43.086819Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:47.311 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:47.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:47 trial097 ceph-mon[21799]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:47.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:47 trial119 ceph-mon[24143]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:47.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:47 trial114 ceph-mon[23907]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:48.312 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:48.430 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:48.659 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:48.660 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:43.086819Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:48.697 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:48.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:48 trial097 ceph-mon[21799]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:48.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:48 trial097 ceph-mon[21799]: pgmap v76: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s wr, 0 op/s 2026-02-18T03:16:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:48 trial119 ceph-mon[24143]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:48 trial119 ceph-mon[24143]: pgmap v76: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s wr, 0 op/s 2026-02-18T03:16:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:48 trial114 ceph-mon[23907]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:48 trial114 ceph-mon[23907]: pgmap v76: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s wr, 0 op/s 2026-02-18T03:16:49.698 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:49.816 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:49.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:49 trial097 ceph-mon[21799]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:49.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:49 trial119 ceph-mon[24143]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:49.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:49 trial119 bash[34248]: Copying config sha256:99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 2026-02-18T03:16:49.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:49 trial119 bash[34248]: Writing manifest to image destination 2026-02-18T03:16:49.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:49 trial119 podman[34248]: 2026-02-18 03:16:49.832988239 +0000 UTC m=+6.213830581 container create 2bb9fda5181950e2e95cfca1a40a8129d3765c42b231f020df069768b0203e1d (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.ceph-release=20.2.0, io.ceph.nvmeof=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, version=1.6.5, build-date=2026-02-11 09:53:49 UTC, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, release=, io.ceph.git.branch=devel, vcs-type=git, maintainer=Ceph Developers , io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.maintainer=Ceph Developers , io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, name=ceph-nvmeof, io.spdk.git.branch=undefined, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, com.redhat.component=ubi9-container, url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.spdk.build.makeflags=, io.buildah.version=1.29.0, vendor=Red Hat, Inc., io.ceph.version=1.6.5, io.ceph.component=ceph-nvmeof) 2026-02-18T03:16:49.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:49 trial119 podman[34248]: 2026-02-18 03:16:49.826729788 +0000 UTC m=+6.207572120 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:16:49.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:49 trial119 podman[34248]: 2026-02-18 03:16:49.86700656 +0000 UTC m=+6.247848892 container init 2bb9fda5181950e2e95cfca1a40a8129d3765c42b231f020df069768b0203e1d (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c, io.ceph.nvmeof=, io.ceph.component=ceph-nvmeof, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, release=, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, vcs-type=git, io.spdk.git.repo=https://github.com/ceph/spdk.git, maintainer=Ceph Developers , distribution-scope=public, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, io.buildah.version=1.29.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.summary=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-30.el9, io.ceph.version=1.6.5, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, version=1.6.5, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, name=ceph-nvmeof, vendor=Red Hat, Inc., vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.git.branch=devel, com.redhat.component=ubi9-container, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, summary=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=undefined) 2026-02-18T03:16:49.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:49 trial119 podman[34248]: 2026-02-18 03:16:49.869314523 +0000 UTC m=+6.250156865 container start 2bb9fda5181950e2e95cfca1a40a8129d3765c42b231f020df069768b0203e1d (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, maintainer=Ceph Developers , build-date=2026-02-11 09:53:49 UTC, release=, io.spdk.git.branch=undefined, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-type=git, io.ceph.nvmeof=, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.target-arch=x86-64-v2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, version=1.6.5, url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., org.centos.version=9.0-30.el9, com.redhat.component=ubi9-container, distribution-scope=public, io.ceph.maintainer=Ceph Developers , vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.branch=devel, architecture=x86_64, io.buildah.version=1.29.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.wants=ceph,rbd, io.spdk.build.ceph-release=20.2.0, name=ceph-nvmeof) 2026-02-18T03:16:49.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:49 trial119 bash[34248]: 2bb9fda5181950e2e95cfca1a40a8129d3765c42b231f020df069768b0203e1d 2026-02-18T03:16:49.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:49 trial119 systemd[1]: Started Ceph nvmeof.nvmeof.c for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:16:49.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:49 trial114 ceph-mon[23907]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:50.049 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:50.049 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:49.919788Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:50.090 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:50.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:16:50.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c, using rotation 2026-02-18T03:16:50.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:16:50.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): [gateway] 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): name = client.nvmeof.nvmeof.c 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): addr = 10.20.193.119 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): port = 5500 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:16:50.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:16:50.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:50.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:16:50.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): force_tls = False 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:16:50.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): 2026-02-18T03:16:50.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:16:50.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:16:50.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:16:50.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:16:50.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:16:50.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:16:50.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:16:50.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:16:50.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): [discovery] 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): addr = 10.20.193.119 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): port = 8009 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): 2026-02-18T03:16:50.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): [ceph] 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): pool = mypool 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): id = nvmeof.nvmeof.c 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): [mtls] 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:16:50.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): [spdk] 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): transports = tcp 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:16:50.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): [monitor] 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.c 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:16:50.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.119:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.119:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:16:50.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:16:50.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:50] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.119:5499 for group id 2026-02-18T03:16:50.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Trying to pull quay.io/ceph/nvmeof:devel... 2026-02-18T03:16:50.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:50 trial097 ceph-mon[21799]: pgmap v77: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s wr, 0 op/s 2026-02-18T03:16:50.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:50 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:50 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:50 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:50 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:50.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:50 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:50.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:50 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:50.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Getting image source signatures 2026-02-18T03:16:50.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Copying blob sha256:e1ad571dfbd92db00152ab9cd6103ce1496b77b702f05f6f8a3c34f35c60b2c9 2026-02-18T03:16:50.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2026-02-18T03:16:50.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Copying blob sha256:3c74c9b146a29bfada03feb9fb249c05e0ba7dfa7a35ef659d40b403a3638baa 2026-02-18T03:16:50.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Copying blob sha256:9bc0f775acafdf3d8cec026216b4d1af8405c4383413c5488232c22180fc440b 2026-02-18T03:16:50.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Copying blob sha256:8d5bd62c11c679d096279fd5d8ef3c429c0843067310e0c75a0fb3a7a6bc56e5 2026-02-18T03:16:50.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Copying blob sha256:c1222dc7ae510c1747954c83b2d87b79c1f7ad23a782e560bce90c2fb40fc391 2026-02-18T03:16:50.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Copying blob sha256:a7ffbc3af914b27a37e5a4bc0d1c4d4b85c7040f0ab0e4de4023ae4bdca097b3 2026-02-18T03:16:50.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:50 trial097 bash[47728]: Copying blob sha256:28334eab29c252fcb610de92adc0b20cbad462a56beba9241601f27496857eda 2026-02-18T03:16:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-mon[24143]: pgmap v77: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s wr, 0 op/s 2026-02-18T03:16:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:50.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:50.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:50 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:50 trial114 ceph-mon[23907]: pgmap v77: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s wr, 0 op/s 2026-02-18T03:16:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:50 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:50 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:50 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:50 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:16:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:50 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:16:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:50 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:51.091 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:51.221 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:51.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:51 trial097 ceph-mon[21799]: gateway address: 10.20.193.97 from map_addr=None spec.addr=None host_ip='10.20.193.97' 2026-02-18T03:16:51.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:51 trial097 ceph-mon[21799]: discovery address: 10.20.193.97 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.97' 2026-02-18T03:16:51.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:51 trial097 ceph-mon[21799]: Deploying daemon nvmeof.nvmeof.a on trial097 2026-02-18T03:16:51.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:51 trial097 ceph-mon[21799]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:51.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:51 trial119 ceph-mon[24143]: gateway address: 10.20.193.97 from map_addr=None spec.addr=None host_ip='10.20.193.97' 2026-02-18T03:16:51.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:51 trial119 ceph-mon[24143]: discovery address: 10.20.193.97 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.97' 2026-02-18T03:16:51.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:51 trial119 ceph-mon[24143]: Deploying daemon nvmeof.nvmeof.a on trial097 2026-02-18T03:16:51.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:51 trial119 ceph-mon[24143]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:51.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:51 trial114 ceph-mon[23907]: gateway address: 10.20.193.97 from map_addr=None spec.addr=None host_ip='10.20.193.97' 2026-02-18T03:16:51.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:51 trial114 ceph-mon[23907]: discovery address: 10.20.193.97 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.97' 2026-02-18T03:16:51.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:51 trial114 ceph-mon[23907]: Deploying daemon nvmeof.nvmeof.a on trial097 2026-02-18T03:16:51.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:51 trial114 ceph-mon[23907]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:52.264 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:52.264 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:15:51.805231Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:15:51.805178Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:49.919788Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:15:51.805266Z", "running": 4, "size": 4}}] 2026-02-18T03:16:52.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:52 trial097 ceph-mon[21799]: pgmap v78: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:52 trial119 ceph-mon[24143]: pgmap v78: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:52 trial114 ceph-mon[23907]: pgmap v78: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:53 trial097 ceph-mon[21799]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:53.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:53 trial119 ceph-mon[24143]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:53.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:53 trial114 ceph-mon[23907]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:54.191 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:16:54.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 bash[47728]: Copying config sha256:99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 2026-02-18T03:16:54.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 bash[47728]: Writing manifest to image destination 2026-02-18T03:16:54.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 podman[47728]: 2026-02-18 03:16:54.226498697 +0000 UTC m=+3.778305765 container create 94f13e3a26187a56734595cf88fbc6f6a6b77a3272dcdb80752764948b12f25e (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.build.pkgdep-args=--rbd, distribution-scope=public, vcs-type=git, io.ceph.maintainer=Ceph Developers , name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc., build-date=2026-02-11 09:53:49 UTC, io.ceph.component=ceph-nvmeof, release=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.makeflags=, io.spdk.version=25.09, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.ceph-release=20.2.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=undefined, io.ceph.version=1.6.5, io.ceph.url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.ceph.nvmeof=, architecture=x86_64, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.target-arch=x86-64-v2, maintainer=Ceph Developers , org.centos.version=9.0-30.el9, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2) 2026-02-18T03:16:54.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 podman[47728]: 2026-02-18 03:16:54.220233473 +0000 UTC m=+3.772040531 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:16:54.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 podman[47728]: 2026-02-18 03:16:54.26394935 +0000 UTC m=+3.815756418 container init 94f13e3a26187a56734595cf88fbc6f6a6b77a3272dcdb80752764948b12f25e (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, io.ceph.component=ceph-nvmeof, io.spdk.version=25.09, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, name=ceph-nvmeof, maintainer=Ceph Developers , io.ceph.nvmeof=, io.ceph.version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, distribution-scope=public, io.spdk.git.branch=undefined, architecture=x86_64, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.pkgdep-args=--rbd, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.target-arch=x86-64-v2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., release=, io.openshift.wants=ceph,rbd, io.ceph.maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, io.ceph.git.branch=devel, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, vcs-type=git) 2026-02-18T03:16:54.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 podman[47728]: 2026-02-18 03:16:54.266016558 +0000 UTC m=+3.817823636 container start 94f13e3a26187a56734595cf88fbc6f6a6b77a3272dcdb80752764948b12f25e (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, io.ceph.component=ceph-nvmeof, io.ceph.nvmeof=, io.spdk.git.branch=undefined, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vendor=Red Hat, Inc., vcs-type=git, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.pkgdep-args=--rbd, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.target-arch=x86-64-v2, release=, io.ceph.version=1.6.5, io.ceph.git.branch=devel, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, distribution-scope=public, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.ceph-release=20.2.0, org.centos.version=9.0-30.el9, build-date=2026-02-11 09:53:49 UTC, architecture=x86_64, version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, name=ceph-nvmeof, maintainer=Ceph Developers ) 2026-02-18T03:16:54.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 bash[47728]: 94f13e3a26187a56734595cf88fbc6f6a6b77a3272dcdb80752764948b12f25e 2026-02-18T03:16:54.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 systemd[1]: Started Ceph nvmeof.nvmeof.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:16:54.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:16:54.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a, using rotation 2026-02-18T03:16:54.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:16:54.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): [gateway] 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): name = client.nvmeof.nvmeof.a 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): addr = 10.20.193.97 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): port = 5500 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:16:54.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:16:54.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:16:54.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:16:54.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): force_tls = False 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:16:54.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): [discovery] 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): addr = 10.20.193.97 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): port = 8009 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): [ceph] 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): pool = mypool 2026-02-18T03:16:54.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): id = nvmeof.nvmeof.a 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): [mtls] 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): [spdk] 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:16:54.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): transports = tcp 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): 2026-02-18T03:16:54.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): [monitor] 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.a 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.97:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.97:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:16:54.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:54] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.97:5499 for group id 2026-02-18T03:16:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-mon[21799]: pgmap v79: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:54 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:54 trial119 ceph-mon[24143]: pgmap v79: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:54 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:54 trial114 ceph-mon[23907]: pgmap v79: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:54 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:55.192 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:16:55.312 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:16:55.541 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-18T03:16:55.541 INFO:teuthology.orchestra.run.trial097.stdout:[{"events": ["2026-02-18T03:15:29.293127Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial097=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:15:29.284973Z", "last_refresh": "2026-02-18T03:16:54.876303Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:15:22.315388Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial097:10.20.193.97=a", "trial114:10.20.193.114=b", "trial119:10.20.193.119=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:15:15.590256Z", "last_refresh": "2026-02-18T03:16:54.839617Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:16:54.317622Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial097=nvmeof.a", "trial114=nvmeof.b", "trial119=nvmeof.c", "trial194=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:16:26.507573Z", "last_refresh": "2026-02-18T03:16:54.819999Z", "ports": [5500, 4420, 8009, 10008], "running": 4, "size": 4}}, {"events": ["2026-02-18T03:15:59.962949Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial194"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_4"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:15:59.961191Z", "last_refresh": "2026-02-18T03:16:54.819940Z", "running": 4, "size": 4}}] 2026-02-18T03:16:55.578 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 4/4 2026-02-18T03:16:55.578 INFO:teuthology.run_tasks:Running task workunit... 2026-02-18T03:16:55.605 INFO:tasks.workunit:Pulling workunits from ref adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:16:55.605 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-18T03:16:55.606 DEBUG:teuthology.orchestra.run.trial031:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:16:55.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:16:55.624 INFO:teuthology.orchestra.run.trial031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-18T03:16:55.625 DEBUG:teuthology.orchestra.run.trial031:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:16:55.680 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-18T03:16:55.681 DEBUG:teuthology.orchestra.run.trial031:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-18T03:16:55.738 INFO:tasks.workunit:timeout=3h 2026-02-18T03:16:55.738 INFO:tasks.workunit:cleanup=True 2026-02-18T03:16:55.739 DEBUG:teuthology.orchestra.run.trial031:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:16:55.802 INFO:tasks.workunit.client.0.trial031.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-18T03:16:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.a group id=0 2026-02-18T03:16:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:16:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:16:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:16:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:16:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:16:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:16:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:16:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:16:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:55] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:16:55.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:55.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: Health check failed: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway. (NVMEOF_SINGLE_GATEWAY) 2026-02-18T03:16:55.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:55.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:55 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:16:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: Health check failed: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway. (NVMEOF_SINGLE_GATEWAY) 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:55.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:55 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:16:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:55.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:55.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: Health check failed: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway. (NVMEOF_SINGLE_GATEWAY) 2026-02-18T03:16:55.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:55.976 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:55 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:56.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:16:56.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:56.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:56.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: pgmap v80: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:56.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:56.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: Health check cleared: NVMEOF_SINGLE_GATEWAY (was: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway.) 2026-02-18T03:16:56.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: Cluster is now healthy 2026-02-18T03:16:56.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:56.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:56 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:16:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: pgmap v80: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: Health check cleared: NVMEOF_SINGLE_GATEWAY (was: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway.) 2026-02-18T03:16:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: Cluster is now healthy 2026-02-18T03:16:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:56 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:16:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: pgmap v80: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:16:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: Health check cleared: NVMEOF_SINGLE_GATEWAY (was: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway.) 2026-02-18T03:16:56.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: Cluster is now healthy 2026-02-18T03:16:56.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:56.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:56.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.b group id=1 2026-02-18T03:16:56.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:16:56.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:16:56.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:16:56.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:16:56.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:16:56.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:16:56.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:16:56.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:16:56.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:56] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:16:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.c group id=2 2026-02-18T03:16:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:16:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:16:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:16:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:16:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:16:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:16:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:16:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:16:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:57] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:16:57.780 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-mon[21799]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:57.780 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:57.780 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:57.781 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:57.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:656 (2): SPDK process id: 76 2026-02-18T03:16:57.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:16:57.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: INFO: Setting log level to WARNING 2026-02-18T03:16:57.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.520365] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.520413] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid76 ] 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.636014] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.664174] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.664183] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.664192] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.664193] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:16:57.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.779092] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:16:57.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-mon[24143]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:57.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:57.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:57.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:57 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:57.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:57 trial114 ceph-mon[23907]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:57.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:57 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:57.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:57 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:16:57.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:57 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:16:58.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:473 (2): Discovery service process id: 81 2026-02-18T03:16:58.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:461 (81): Starting ceph nvmeof discovery service 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO state.py:894 (81): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO discovery.py:344 (81): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO discovery.py:369 (81): discovery addr: 10.20.193.97 port: 8009 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO cephutils.py:189 (2): Cluster ID is eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO state.py:2073 (81): Initialization is over (discovery-trial097). 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:16:58.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.826338] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:16:58.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:16:57.826370] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:16:58.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:16:58.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO cephutils.py:308 (2): Registered nvmeof.a to service_map! 2026-02-18T03:16:58.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:16:58.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:16:58.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:16:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:16:57] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:16:58.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.d group id=3 2026-02-18T03:16:58.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:16:58.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:16:58.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:16:58.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:16:58.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:16:58.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:16:58.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:16:58.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:16:58.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:16:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:16:58] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:16:58.922 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:58] INFO server.py:656 (2): SPDK process id: 139 2026-02-18T03:16:58.922 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:58] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: INFO: Setting log level to WARNING 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:58] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:58.780742] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:58.780790] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid139 ] 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:58.898135] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:58.920913] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:58.920921] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:58.920929] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:16:58.923 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:58.920930] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: pgmap v81: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3461877920' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1829099690' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.924 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:58.925 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.926 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: pgmap v81: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3461877920' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1829099690' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:58.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:59.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:16:59.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: pgmap v81: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:16:59.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3461877920' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:16:59.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1829099690' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:16:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:16:59.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:58] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:16:59.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:58] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:16:59.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:59.054269] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO server.py:473 (2): Discovery service process id: 144 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO server.py:461 (144): Starting ceph nvmeof discovery service 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO state.py:894 (144): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO discovery.py:344 (144): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO discovery.py:369 (144): discovery addr: 10.20.193.114 port: 8009 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO cephutils.py:189 (2): Cluster ID is eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:16:59.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO state.py:2073 (144): Initialization is over (discovery-trial114). 2026-02-18T03:16:59.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:16:59.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:59.101502] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:16:59.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:16:59.101530] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:16:59.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:16:59.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO cephutils.py:308 (2): Registered nvmeof.b to service_map! 2026-02-18T03:16:59.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:16:59.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:16:59.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:16:59] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:16:59.393 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:656 (2): SPDK process id: 94 2026-02-18T03:16:59.393 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:16:59.393 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: INFO: Setting log level to WARNING 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.115014] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.115057] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94 ] 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.232321] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.257364] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.257373] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.257381] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.257383] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:16:59.394 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:16:59.395 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:16:59.395 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.391645] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:16:59.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:16:59.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:473 (2): Discovery service process id: 99 2026-02-18T03:16:59.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:461 (99): Starting ceph nvmeof discovery service 2026-02-18T03:16:59.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:16:59.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO state.py:894 (99): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:16:59.657 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO discovery.py:344 (99): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:16:59.657 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO discovery.py:369 (99): discovery addr: 10.20.193.119 port: 8009 2026-02-18T03:16:59.657 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO cephutils.py:189 (2): Cluster ID is eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:16:59.657 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:16:59.657 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:16:59.657 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:16:59.657 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO state.py:2073 (99): Initialization is over (discovery-trial119). 2026-02-18T03:16:59.657 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:16:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.438947] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:16:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:16:59.438981] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:16:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:16:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO cephutils.py:308 (2): Registered nvmeof.c to service_map! 2026-02-18T03:16:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:16:59.658 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:16:59.659 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:16:59] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:16:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:16:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: Adding NVMeoF gateway 10.20.193.97:5500 to Dashboard 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: Adding NVMeoF gateway 10.20.193.114:5500 to Dashboard 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: Adding NVMeoF gateway 10.20.193.119:5500 to Dashboard 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: Adding NVMeoF gateway 10.20.193.194:5500 to Dashboard 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2580009813' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/69642445' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:16:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3061370607' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:16:59.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:16:59 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3361323731' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: Adding NVMeoF gateway 10.20.193.97:5500 to Dashboard 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: Adding NVMeoF gateway 10.20.193.114:5500 to Dashboard 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: Adding NVMeoF gateway 10.20.193.119:5500 to Dashboard 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: Adding NVMeoF gateway 10.20.193.194:5500 to Dashboard 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:16:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2580009813' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:16:59.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/69642445' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:16:59.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3061370607' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:16:59.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:16:59 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3361323731' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:00.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:17:00.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: Adding NVMeoF gateway 10.20.193.97:5500 to Dashboard 2026-02-18T03:17:00.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: Adding NVMeoF gateway 10.20.193.114:5500 to Dashboard 2026-02-18T03:17:00.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: Adding NVMeoF gateway 10.20.193.119:5500 to Dashboard 2026-02-18T03:17:00.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: Adding NVMeoF gateway 10.20.193.194:5500 to Dashboard 2026-02-18T03:17:00.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:17:00.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:17:00.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:17:00.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:17:00.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2580009813' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:17:00.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/69642445' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:00.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3061370607' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:17:00.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:16:59 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3361323731' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:00.566 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:656 (2): SPDK process id: 118 2026-02-18T03:17:00.566 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:17:00.566 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: INFO: Setting log level to WARNING 2026-02-18T03:17:00.566 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.289135] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.289267] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid118 ] 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.406785] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.430153] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.430167] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.430175] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.430176] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:17:00.567 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.563581] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:17:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:17:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:473 (2): Discovery service process id: 123 2026-02-18T03:17:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:461 (123): Starting ceph nvmeof discovery service 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO state.py:894 (123): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO discovery.py:344 (123): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO discovery.py:369 (123): discovery addr: 10.20.193.194 port: 8009 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO cephutils.py:189 (2): Cluster ID is eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO state.py:2073 (123): Initialization is over (discovery-trial194). 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:17:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:17:00.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:17:00.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.610845] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:17:00.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:00.610871] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:17:00.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:00.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO cephutils.py:308 (2): Registered nvmeof.d to service_map! 2026-02-18T03:17:00.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:17:00.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:17:00.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:00] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:17:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:00 trial119 ceph-mon[24143]: pgmap v82: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 597 B/s rd, 0 B/s wr, 0 op/s 2026-02-18T03:17:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:00 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2290775534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:17:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:00 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1812421485' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:00 trial114 ceph-mon[23907]: pgmap v82: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 597 B/s rd, 0 B/s wr, 0 op/s 2026-02-18T03:17:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:00 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2290775534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:17:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:00 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1812421485' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:01.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:00 trial097 ceph-mon[21799]: pgmap v82: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 597 B/s rd, 0 B/s wr, 0 op/s 2026-02-18T03:17:01.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2290775534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:17:01.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1812421485' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:02 trial119 ceph-mon[24143]: pgmap v83: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 597 B/s rd, 0 B/s wr, 0 op/s 2026-02-18T03:17:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:02 trial114 ceph-mon[23907]: pgmap v83: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 597 B/s rd, 0 B/s wr, 0 op/s 2026-02-18T03:17:03.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:02 trial097 ceph-mon[21799]: pgmap v83: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 597 B/s rd, 0 B/s wr, 0 op/s 2026-02-18T03:17:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:04 trial119 ceph-mon[24143]: pgmap v84: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:04 trial114 ceph-mon[23907]: pgmap v84: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:05.153 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:04 trial097 ceph-mon[21799]: pgmap v84: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:05.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:05 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3330692382' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:05.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:05 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3330692382' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:06.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:05 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3330692382' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:06 trial119 ceph-mon[24143]: pgmap v85: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:06 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/258699001' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:06 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2568440864' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:06 trial114 ceph-mon[23907]: pgmap v85: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:06.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:06 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/258699001' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:06.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:06 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2568440864' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:07.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:06 trial097 ceph-mon[21799]: pgmap v85: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:07.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:06 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/258699001' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:07.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:06 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2568440864' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:07.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:07 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2549911105' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:07.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:07 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2549911105' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:08.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:07 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2549911105' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:08 trial119 ceph-mon[24143]: pgmap v86: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:08 trial114 ceph-mon[23907]: pgmap v86: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:09.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:08 trial097 ceph-mon[21799]: pgmap v86: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:17:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:10 trial119 ceph-mon[24143]: pgmap v87: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:17:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:10 trial114 ceph-mon[23907]: pgmap v87: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:17:11.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:10 trial097 ceph-mon[21799]: pgmap v87: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:17:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:12 trial119 ceph-mon[24143]: pgmap v88: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/728372290' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:12 trial114 ceph-mon[23907]: pgmap v88: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:12.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/728372290' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:13.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:12 trial097 ceph-mon[21799]: pgmap v88: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:13.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/728372290' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:13.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/946022210' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:13.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/654351836' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:13.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/946022210' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:13.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/654351836' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:14.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/946022210' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:14.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/654351836' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:14.887 INFO:tasks.workunit.client.0.trial031.stderr:Note: switching to 'adc1923395f2bcd6ae89b5d331d278364d1848ed'. 2026-02-18T03:17:14.887 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:17:14.887 INFO:tasks.workunit.client.0.trial031.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr:state without impacting any branches by switching back to a branch. 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr: git switch -c 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr:Or undo this operation with: 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:17:14.888 INFO:tasks.workunit.client.0.trial031.stderr: git switch - 2026-02-18T03:17:14.889 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:17:14.889 INFO:tasks.workunit.client.0.trial031.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-18T03:17:14.889 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:17:14.889 INFO:tasks.workunit.client.0.trial031.stderr:HEAD is now at adc1923395f Merge PR #67279 into tentacle 2026-02-18T03:17:14.894 DEBUG:teuthology.orchestra.run.trial031:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-18T03:17:14.954 INFO:tasks.workunit.client.0.trial031.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-18T03:17:14.955 INFO:tasks.workunit.client.0.trial031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-18T03:17:14.956 INFO:tasks.workunit.client.0.trial031.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-18T03:17:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:14 trial119 ceph-mon[24143]: pgmap v89: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:17:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1491069076' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:14 trial114 ceph-mon[23907]: pgmap v89: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:17:14.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1491069076' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:15.051 INFO:tasks.workunit.client.0.trial031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-18T03:17:15.082 INFO:tasks.workunit.client.0.trial031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-18T03:17:15.108 INFO:tasks.workunit.client.0.trial031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-18T03:17:15.110 INFO:tasks.workunit.client.0.trial031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-18T03:17:15.110 INFO:tasks.workunit.client.0.trial031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-18T03:17:15.133 INFO:tasks.workunit.client.0.trial031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-18T03:17:15.137 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:17:15.137 DEBUG:teuthology.orchestra.run.trial031:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-18T03:17:15.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:14 trial097 ceph-mon[21799]: pgmap v89: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:17:15.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1491069076' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:15.196 INFO:tasks.workunit:Running workunits matching nvmeof/setup_subsystem.sh on client.0... 2026-02-18T03:17:15.199 INFO:tasks.workunit:Running workunit nvmeof/setup_subsystem.sh... 2026-02-18T03:17:15.199 DEBUG:teuthology.orchestra.run.trial031:workunit test nvmeof/setup_subsystem.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/nvmeof/setup_subsystem.sh 2026-02-18T03:17:15.254 INFO:tasks.workunit.client.0.trial031.stderr:+ source /etc/ceph/nvmeof.env 2026-02-18T03:17:15.254 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=10.20.193.97,10.20.193.114,10.20.193.119,10.20.193.194 2026-02-18T03:17:15.254 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_GATEWAY_NAMES=trial097,trial114,trial119,trial194 2026-02-18T03:17:15.254 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=10.20.193.97 2026-02-18T03:17:15.254 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_CLI_IMAGE=quay.io/ceph/nvmeof-cli:devel 2026-02-18T03:17:15.254 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2026-02-18T03:17:15.254 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=3 2026-02-18T03:17:15.254 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_NAMESPACES_COUNT=20 2026-02-18T03:17:15.255 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_PORT=4420 2026-02-18T03:17:15.255 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_SRPORT=5500 2026-02-18T03:17:15.255 INFO:tasks.workunit.client.0.trial031.stderr:+ RBD_POOL=mypool 2026-02-18T03:17:15.255 INFO:tasks.workunit.client.0.trial031.stderr:+ RBD_IMAGE_PREFIX=myimage 2026-02-18T03:17:15.255 INFO:tasks.workunit.client.0.trial031.stderr:++ hostname 2026-02-18T03:17:15.255 INFO:tasks.workunit.client.0.trial031.stderr:+ HOSTNAME=trial031 2026-02-18T03:17:15.255 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman images 2026-02-18T03:17:15.278 INFO:tasks.workunit.client.0.trial031.stdout:REPOSITORY TAG IMAGE ID CREATED SIZE 2026-02-18T03:17:15.278 INFO:tasks.workunit.client.0.trial031.stdout:quay.ceph.io/ceph-ci/ceph adc1923395f2bcd6ae89b5d331d278364d1848ed c2bc6184fe25 9 hours ago 1.5 GB 2026-02-18T03:17:15.279 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman ps 2026-02-18T03:17:15.298 INFO:tasks.workunit.client.0.trial031.stdout:CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-02-18T03:17:15.300 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 --format json subsystem list 2026-02-18T03:17:15.321 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:15Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:15.322 INFO:tasks.workunit.client.0.trial031.stderr:Trying to pull quay.io/ceph/nvmeof-cli:devel... 2026-02-18T03:17:16.102 INFO:tasks.workunit.client.0.trial031.stderr:Getting image source signatures 2026-02-18T03:17:16.102 INFO:tasks.workunit.client.0.trial031.stderr:Copying blob sha256:8d156a03ba1d0e221bdc715d1f586584566143ee24d6a8ce5862d2d78a537de8 2026-02-18T03:17:16.102 INFO:tasks.workunit.client.0.trial031.stderr:Copying blob sha256:a1657f41d50b3dea43d9f14f954d778bf71e11849920e76a92e0a7a1ed54a9c6 2026-02-18T03:17:16.102 INFO:tasks.workunit.client.0.trial031.stderr:Copying blob sha256:4911ac1c694be040dfc35b15ab9a3e8fe41402902e5ffc1951f5e80fe270d569 2026-02-18T03:17:16.102 INFO:tasks.workunit.client.0.trial031.stderr:Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2026-02-18T03:17:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:16 trial119 ceph-mon[24143]: pgmap v90: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:16 trial114 ceph-mon[23907]: pgmap v90: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:17.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:16 trial097 ceph-mon[21799]: pgmap v90: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:18 trial119 ceph-mon[24143]: pgmap v91: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:18.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:18 trial114 ceph-mon[23907]: pgmap v91: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:19.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:18 trial097 ceph-mon[21799]: pgmap v91: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:19.238 INFO:tasks.workunit.client.0.trial031.stderr:Copying config sha256:c1d149b89595cfbff7052465bea1a1a102db7eda9044d53e28d55eb8b3d1b1d3 2026-02-18T03:17:19.239 INFO:tasks.workunit.client.0.trial031.stderr:Writing manifest to image destination 2026-02-18T03:17:19.701 INFO:tasks.workunit.client.0.trial031.stdout:{ 2026-02-18T03:17:19.701 INFO:tasks.workunit.client.0.trial031.stdout: "error_message": "Success", 2026-02-18T03:17:19.701 INFO:tasks.workunit.client.0.trial031.stdout: "status": 0, 2026-02-18T03:17:19.702 INFO:tasks.workunit.client.0.trial031.stdout: "subsystems": [] 2026-02-18T03:17:19.702 INFO:tasks.workunit.client.0.trial031.stdout:} 2026-02-18T03:17:19.724 INFO:tasks.workunit.client.0.trial031.stderr:+ IFS=, 2026-02-18T03:17:19.724 INFO:tasks.workunit.client.0.trial031.stderr:+ read -ra gateway_ips 2026-02-18T03:17:19.724 INFO:tasks.workunit.client.0.trial031.stderr:+ IFS=, 2026-02-18T03:17:19.724 INFO:tasks.workunit.client.0.trial031.stderr:+ read -ra gateway_names 2026-02-18T03:17:19.725 INFO:tasks.workunit.client.0.trial031.stderr:++ echo 10.20.193.97,10.20.193.114,10.20.193.119,10.20.193.194 2026-02-18T03:17:19.725 INFO:tasks.workunit.client.0.trial031.stderr:++ tr -cd , 2026-02-18T03:17:19.725 INFO:tasks.workunit.client.0.trial031.stderr:++ wc -c 2026-02-18T03:17:19.726 INFO:tasks.workunit.client.0.trial031.stderr:+ gateways_count=4 2026-02-18T03:17:19.726 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Starting subsystem setup...' 2026-02-18T03:17:19.727 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Starting subsystem setup... 2026-02-18T03:17:19.727 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 3 2026-02-18T03:17:19.727 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:19.727 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:17:19.728 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode1 --no-group-append 2026-02-18T03:17:19.776 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:19Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:19.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1926076479' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:19.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1926076479' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:20.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1926076479' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:19 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:19] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.31:46636 2026-02-18T03:17:20.757 INFO:tasks.workunit.client.0.trial031.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:20.781 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:20.782 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:17:20.782 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode2 --no-group-append 2026-02-18T03:17:20.813 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:20Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:20 trial119 ceph-mon[24143]: pgmap v92: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:17:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:20 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3585445297' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:20.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:20 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/114167444' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:20 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:20] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:20 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:20.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:20 trial114 ceph-mon[23907]: pgmap v92: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:17:20.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:20 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3585445297' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:20.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:20 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/114167444' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:20.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:20 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:20.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:20 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:20] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:20 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:20] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:20 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-mon[21799]: pgmap v92: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:17:21.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3585445297' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:21.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/114167444' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:21.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:20] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.31:49752 2026-02-18T03:17:21.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:20] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:21.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:20] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode1, will use Ceph163465633537 2026-02-18T03:17:21.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:20] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:17:21.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:20] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode1, OMAP version: 2 2026-02-18T03:17:21.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:20] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:20 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.333 INFO:tasks.workunit.client.0.trial031.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:21.352 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:21.352 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:17:21.352 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode3 --no-group-append 2026-02-18T03:17:21.384 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:21.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO state.py:1684 (2): Start update from 1 to 2 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:21.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:21.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO state.py:1684 (123): Start update from 1 to 2 (discovery-trial194). 2026-02-18T03:17:21.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO state.py:2068 (123): Update complete (1 -> 2) (discovery-trial194). 2026-02-18T03:17:21.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO state.py:2068 (2): Update complete (1 -> 2) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:21.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO state.py:1684 (81): Start update from 1 to 2 (discovery-trial097). 2026-02-18T03:17:21.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO state.py:2068 (81): Update complete (1 -> 2) (discovery-trial097). 2026-02-18T03:17:21.654 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.31:38210 2026-02-18T03:17:21.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:21.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode2, will use Ceph23661839356249 2026-02-18T03:17:21.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:17:21.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode2, OMAP version: 3 2026-02-18T03:17:21.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO state.py:1684 (99): Start update from 1 to 2 (discovery-trial119). 2026-02-18T03:17:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO state.py:2068 (99): Update complete (1 -> 2) (discovery-trial119). 2026-02-18T03:17:21.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO state.py:1684 (2): Start update from 1 to 2 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:21.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:21.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO state.py:2068 (2): Update complete (1 -> 2) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:21.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO state.py:1684 (2): Start update from 1 to 2 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:21.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:21.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO state.py:1684 (144): Start update from 1 to 2 (discovery-trial114). 2026-02-18T03:17:21.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO state.py:2068 (144): Update complete (1 -> 2) (discovery-trial114). 2026-02-18T03:17:21.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO state.py:2068 (2): Update complete (1 -> 2) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:21.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:21.873 INFO:tasks.workunit.client.0.trial031.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:17:21.892 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:17:21.892 INFO:tasks.workunit.client.0.trial031.stderr:+ ip=10.20.193.97 2026-02-18T03:17:21.892 INFO:tasks.workunit.client.0.trial031.stderr:+ name=trial097 2026-02-18T03:17:21.893 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 3 2026-02-18T03:17:21.894 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:21.894 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:17:21.894 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.97 and name trial097' 2026-02-18T03:17:21.894 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.97 and name trial097 2026-02-18T03:17:21.895 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name trial097 --traddr 10.20.193.97 --trsvcid 4420 2026-02-18T03:17:21.928 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:22.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO state.py:1684 (2): Start update from 2 to 3 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:22.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO state.py:1684 (123): Start update from 2 to 3 (discovery-trial194). 2026-02-18T03:17:22.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:22.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO state.py:2068 (123): Update complete (2 -> 3) (discovery-trial194). 2026-02-18T03:17:22.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] INFO state.py:2068 (2): Update complete (2 -> 3) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:22.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:21 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO state.py:1684 (81): Start update from 2 to 3 (discovery-trial097). 2026-02-18T03:17:22.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO state.py:2068 (81): Update complete (2 -> 3) (discovery-trial097). 2026-02-18T03:17:22.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.31:46432 2026-02-18T03:17:22.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:22.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode3, will use Ceph9703392782333 2026-02-18T03:17:22.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:17:22.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode3, OMAP version: 4 2026-02-18T03:17:22.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:21 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO state.py:1684 (99): Start update from 2 to 3 (discovery-trial119). 2026-02-18T03:17:22.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO state.py:2068 (99): Update complete (2 -> 3) (discovery-trial119). 2026-02-18T03:17:22.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO state.py:1684 (2): Start update from 2 to 3 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:22.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:22.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] INFO state.py:2068 (2): Update complete (2 -> 3) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:22.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:21 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO state.py:1684 (144): Start update from 2 to 3 (discovery-trial114). 2026-02-18T03:17:22.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO state.py:2068 (144): Update complete (2 -> 3) (discovery-trial114). 2026-02-18T03:17:22.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO state.py:1684 (2): Start update from 2 to 3 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:22.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:22.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] INFO state.py:2068 (2): Update complete (2 -> 3) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:22.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:21 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:21] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] INFO state.py:1684 (81): Start update from 3 to 4 (discovery-trial097). 2026-02-18T03:17:22.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] INFO state.py:2068 (81): Update complete (3 -> 4) (discovery-trial097). 2026-02-18T03:17:22.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.97:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:33742 2026-02-18T03:17:22.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:22.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:22.403033] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.97 port 4420 *** 2026-02-18T03:17:22.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode1_trial097_TCP_10.20.193.97_4420, OMAP version: 5 2026-02-18T03:17:22.422 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 10.20.193.97:4420: Successful 2026-02-18T03:17:22.440 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:22.440 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:17:22.441 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.97 and name trial097 2026-02-18T03:17:22.441 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.97 and name trial097' 2026-02-18T03:17:22.441 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name trial097 --traddr 10.20.193.97 --trsvcid 4420 2026-02-18T03:17:22.479 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:22Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:22.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] INFO state.py:1684 (123): Start update from 3 to 4 (discovery-trial194). 2026-02-18T03:17:22.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] INFO state.py:2068 (123): Update complete (3 -> 4) (discovery-trial194). 2026-02-18T03:17:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] INFO state.py:1684 (2): Start update from 3 to 4 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] INFO state.py:2068 (2): Update complete (3 -> 4) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.680 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] INFO state.py:1684 (2): Start update from 3 to 4 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] INFO state.py:1684 (144): Start update from 3 to 4 (discovery-trial114). 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] INFO state.py:2068 (144): Update complete (3 -> 4) (discovery-trial114). 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] INFO state.py:2068 (2): Update complete (3 -> 4) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] INFO state.py:1684 (99): Start update from 3 to 4 (discovery-trial119). 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] INFO state.py:2068 (99): Update complete (3 -> 4) (discovery-trial119). 2026-02-18T03:17:22.681 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] INFO state.py:1684 (2): Start update from 3 to 4 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:22.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:17:22.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] INFO state.py:2068 (2): Update complete (3 -> 4) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:22.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.924 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 10.20.193.97:4420: Successful 2026-02-18T03:17:22.946 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:22.946 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.97 and name trial097 2026-02-18T03:17:22.947 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:17:22.947 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.97 and name trial097' 2026-02-18T03:17:22.947 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name trial097 --traddr 10.20.193.97 --trsvcid 4420 2026-02-18T03:17:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-mon[24143]: pgmap v93: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:22.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:22 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-mon[23907]: pgmap v93: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:22.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:22 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:22] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:22.996 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:22Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:23.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-mon[21799]: pgmap v93: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:17:23.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.97:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:34784 2026-02-18T03:17:23.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:23.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode2_trial097_TCP_10.20.193.97_4420, OMAP version: 6 2026-02-18T03:17:23.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:22 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:23.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:23.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:22 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:22] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:23.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:23 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:23] INFO state.py:1684 (81): Start update from 4 to 6 (discovery-trial097). 2026-02-18T03:17:23.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:23 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:23] INFO state.py:2068 (81): Update complete (4 -> 6) (discovery-trial097). 2026-02-18T03:17:23.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:23 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:23] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.97:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:47888 2026-02-18T03:17:23.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:23 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:23] INFO state.py:1684 (2): Start update from 4 to 6 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:23] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial097 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:23] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial097 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:23] INFO state.py:2068 (2): Update complete (4 -> 6) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:23] INFO state.py:1684 (144): Start update from 4 to 6 (discovery-trial114). 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:23] INFO state.py:2068 (144): Update complete (4 -> 6) (discovery-trial114). 2026-02-18T03:17:23.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:23] INFO state.py:1684 (99): Start update from 4 to 6 (discovery-trial119). 2026-02-18T03:17:23.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:23] INFO state.py:2068 (99): Update complete (4 -> 6) (discovery-trial119). 2026-02-18T03:17:23.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:23] INFO state.py:1684 (2): Start update from 4 to 6 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:23.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:23] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:23.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial097 2026-02-18T03:17:23.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:23] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:23.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial097 2026-02-18T03:17:23.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:23] INFO state.py:2068 (2): Update complete (4 -> 6) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:23.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:23 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:23] INFO state.py:1684 (2): Start update from 4 to 6 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:23.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:23 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:23] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:23.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:23 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial097 2026-02-18T03:17:23.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:23 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:23] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:23.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:23 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial097 2026-02-18T03:17:23.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:23 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:23] INFO state.py:2068 (2): Update complete (4 -> 6) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:23.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:23 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:23] INFO state.py:1684 (123): Start update from 4 to 6 (discovery-trial194). 2026-02-18T03:17:23.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:23 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:23] INFO state.py:2068 (123): Update complete (4 -> 6) (discovery-trial194). 2026-02-18T03:17:23.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2304790708' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:23.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2304790708' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:24.154 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2304790708' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:24.453 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 10.20.193.97:4420: Successful 2026-02-18T03:17:24.475 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:17:24.475 INFO:tasks.workunit.client.0.trial031.stderr:+ ip=10.20.193.114 2026-02-18T03:17:24.475 INFO:tasks.workunit.client.0.trial031.stderr:+ name=trial114 2026-02-18T03:17:24.475 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 3 2026-02-18T03:17:24.476 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:24.476 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:17:24.476 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.114 and name trial114' 2026-02-18T03:17:24.477 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.114 and name trial114 2026-02-18T03:17:24.477 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.114 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name trial114 --traddr 10.20.193.114 --trsvcid 4420 2026-02-18T03:17:24.522 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:24Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:24.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:24] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:24.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:24] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode3_trial097_TCP_10.20.193.97_4420, OMAP version: 7 2026-02-18T03:17:24.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:24] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:24.685 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:24.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-mon[24143]: pgmap v94: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 17 KiB/s rd, 853 B/s wr, 26 op/s 2026-02-18T03:17:24.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:24] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:24.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:24.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-mon[23907]: pgmap v94: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 17 KiB/s rd, 853 B/s wr, 26 op/s 2026-02-18T03:17:24.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:24.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:24.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:24 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:24] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:24.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:24 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:24.960 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-mon[21799]: pgmap v94: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 17 KiB/s rd, 853 B/s wr, 26 op/s 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:24] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 1 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: OPTIMIZED 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 1 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: OPTIMIZED 2026-02-18T03:17:24.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:24.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:17:24.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:24.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 1 2026-02-18T03:17:24.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: OPTIMIZED 2026-02-18T03:17:24.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:24.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: ], , client address: IPv4 10.20.193.97:44018 2026-02-18T03:17:24.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:24] INFO state.py:1684 (81): Start update from 6 to 7 (discovery-trial097). 2026-02-18T03:17:24.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:24 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:24] INFO state.py:2068 (81): Update complete (6 -> 7) (discovery-trial097). 2026-02-18T03:17:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:24] INFO state.py:1684 (99): Start update from 6 to 7 (discovery-trial119). 2026-02-18T03:17:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:24] INFO state.py:2068 (99): Update complete (6 -> 7) (discovery-trial119). 2026-02-18T03:17:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:24] INFO state.py:1684 (2): Start update from 6 to 7 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:24] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:24] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial097 2026-02-18T03:17:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:24 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:24] INFO state.py:2068 (2): Update complete (6 -> 7) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:25.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.114:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:35638 2026-02-18T03:17:25.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:17:25.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] INFO state.py:1684 (144): Start update from 6 to 7 (discovery-trial114). 2026-02-18T03:17:25.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] INFO state.py:2068 (144): Update complete (6 -> 7) (discovery-trial114). 2026-02-18T03:17:25.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] INFO state.py:1684 (2): Start update from 6 to 7 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:25.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:25.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial097 2026-02-18T03:17:25.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:24 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:24] INFO state.py:2068 (2): Update complete (6 -> 7) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:25.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:24 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:24] INFO state.py:1684 (123): Start update from 6 to 7 (discovery-trial194). 2026-02-18T03:17:25.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:24 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:24] INFO state.py:2068 (123): Update complete (6 -> 7) (discovery-trial194). 2026-02-18T03:17:25.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:24 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:24] INFO state.py:1684 (2): Start update from 6 to 7 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:25.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:24 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:24] INFO grpc.py:6183 (2): Received request to create trial097 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.97:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:25.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:24 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:24] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial097 2026-02-18T03:17:25.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:24 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:24] INFO state.py:2068 (2): Update complete (6 -> 7) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:25.958 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:25 trial114 ceph-mon[23907]: pgmap v95: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 853 B/s wr, 22 op/s 2026-02-18T03:17:25.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:25 trial119 ceph-mon[24143]: pgmap v95: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 853 B/s wr, 22 op/s 2026-02-18T03:17:25.979 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:25 trial097 ceph-mon[21799]: pgmap v95: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 853 B/s wr, 22 op/s 2026-02-18T03:17:25.981 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 10.20.193.114:4420: Successful 2026-02-18T03:17:26.002 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:26.002 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:17:26.002 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.114 and name trial114' 2026-02-18T03:17:26.002 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.114 and name trial114 2026-02-18T03:17:26.003 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.114 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name trial114 --traddr 10.20.193.114 --trsvcid 4420 2026-02-18T03:17:26.045 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:26.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:25 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:25] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:26.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:25 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:25.962542] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.114 port 4420 *** 2026-02-18T03:17:26.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:25 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:25] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode1_trial114_TCP_10.20.193.114_4420, OMAP version: 8 2026-02-18T03:17:26.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:25 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:25] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:25 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:25 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:25 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:25] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:25 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:25] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:25 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:25 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:25] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:25 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.486 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 10.20.193.114:4420: Successful 2026-02-18T03:17:26.506 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:26.506 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:17:26.506 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.114 and name trial114' 2026-02-18T03:17:26.506 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.114 and name trial114 2026-02-18T03:17:26.506 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.114 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name trial114 --traddr 10.20.193.114 --trsvcid 4420 2026-02-18T03:17:26.545 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:26.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3043354534' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:26.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:26] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.114:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:34526 2026-02-18T03:17:26.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:26] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:26] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode2_trial114_TCP_10.20.193.114_4420, OMAP version: 9 2026-02-18T03:17:26.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:26 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:26 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:26] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:26 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3043354534' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:26.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:26 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:26] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:26 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:26 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3043354534' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:26 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:26] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:26 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:26.986 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 10.20.193.114:4420: Successful 2026-02-18T03:17:27.006 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:17:27.006 INFO:tasks.workunit.client.0.trial031.stderr:+ ip=10.20.193.119 2026-02-18T03:17:27.007 INFO:tasks.workunit.client.0.trial031.stderr:+ name=trial119 2026-02-18T03:17:27.007 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 3 2026-02-18T03:17:27.008 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:27.008 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:17:27.008 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.119 and name trial119' 2026-02-18T03:17:27.008 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.119 and name trial119 2026-02-18T03:17:27.008 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.119 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name trial119 --traddr 10.20.193.119 --trsvcid 4420 2026-02-18T03:17:27.047 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:27Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:26] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.114:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:49256 2026-02-18T03:17:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:26] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:26] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode3_trial114_TCP_10.20.193.114_4420, OMAP version: 10 2026-02-18T03:17:27.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:26 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:27.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:26 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:26] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:27.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:26 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:26] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:27.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:26 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:27.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:26 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:26] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:27.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:26 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:27.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO state.py:1684 (123): Start update from 7 to 10 (discovery-trial194). 2026-02-18T03:17:27.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO state.py:2068 (123): Update complete (7 -> 10) (discovery-trial194). 2026-02-18T03:17:27.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO state.py:1684 (2): Start update from 7 to 10 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:27.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial114 2026-02-18T03:17:27.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial114 2026-02-18T03:17:27.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial114 2026-02-18T03:17:27.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:27 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:27] INFO state.py:2068 (2): Update complete (7 -> 10) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-mon[21799]: pgmap v96: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 853 B/s wr, 22 op/s 2026-02-18T03:17:27.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2916619097' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:27.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO state.py:1684 (81): Start update from 7 to 10 (discovery-trial097). 2026-02-18T03:17:27.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO state.py:2068 (81): Update complete (7 -> 10) (discovery-trial097). 2026-02-18T03:17:27.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO state.py:1684 (2): Start update from 7 to 10 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:27.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial114 2026-02-18T03:17:27.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial114 2026-02-18T03:17:27.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial114 2026-02-18T03:17:27.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:27 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:27] INFO state.py:2068 (2): Update complete (7 -> 10) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:27.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-mon[24143]: pgmap v96: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 853 B/s wr, 22 op/s 2026-02-18T03:17:27.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2916619097' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:27.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.119:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:43262 2026-02-18T03:17:27.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] WARNING state.py:688 (2): Local version 7 differs from OMAP file version 10. The file is not current, will reload it and try again 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] WARNING state.py:1642 (2): An update is already running, ignore 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO state.py:1684 (99): Start update from 7 to 10 (discovery-trial119). 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO state.py:2068 (99): Update complete (7 -> 10) (discovery-trial119). 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO state.py:1684 (2): Start update from 7 to 10 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial114 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial114 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial114 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.114:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial114 2026-02-18T03:17:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO state.py:2068 (2): Update complete (7 -> 10) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:27.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:27 trial114 ceph-mon[23907]: pgmap v96: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 853 B/s wr, 22 op/s 2026-02-18T03:17:27.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:27 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2916619097' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:27.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:27 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:27] INFO state.py:1684 (144): Start update from 7 to 10 (discovery-trial114). 2026-02-18T03:17:27.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:27 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:27] INFO state.py:2068 (144): Update complete (7 -> 10) (discovery-trial114). 2026-02-18T03:17:28.007 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 10.20.193.119:4420: Successful 2026-02-18T03:17:28.028 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:28.028 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:17:28.028 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.119 and name trial119' 2026-02-18T03:17:28.028 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.119 and name trial119 2026-02-18T03:17:28.029 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.119 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name trial119 --traddr 10.20.193.119 --trsvcid 4420 2026-02-18T03:17:28.074 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:28.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.119:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:43262 2026-02-18T03:17:28.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:27] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:28.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:27 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:27.987906] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.119 port 4420 *** 2026-02-18T03:17:28.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode1_trial119_TCP_10.20.193.119_4420, OMAP version: 11 2026-02-18T03:17:28.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.538 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 10.20.193.119:4420: Successful 2026-02-18T03:17:28.558 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:28.558 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:17:28.558 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.119 and name trial119' 2026-02-18T03:17:28.558 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.119 and name trial119 2026-02-18T03:17:28.559 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.119 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name trial119 --traddr 10.20.193.119 --trsvcid 4420 2026-02-18T03:17:28.597 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:28.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] INFO state.py:1684 (123): Start update from 10 to 11 (discovery-trial194). 2026-02-18T03:17:28.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] INFO state.py:2068 (123): Update complete (10 -> 11) (discovery-trial194). 2026-02-18T03:17:28.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] INFO state.py:1684 (2): Start update from 10 to 11 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:28.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:28.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial119 2026-02-18T03:17:28.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] INFO state.py:2068 (2): Update complete (10 -> 11) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:28.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:28 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:28] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3325597239' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:28.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] INFO state.py:1684 (81): Start update from 10 to 11 (discovery-trial097). 2026-02-18T03:17:28.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] INFO state.py:2068 (81): Update complete (10 -> 11) (discovery-trial097). 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] INFO state.py:1684 (2): Start update from 10 to 11 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial119 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] INFO state.py:2068 (2): Update complete (10 -> 11) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:28] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 3 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: OPTIMIZED 2026-02-18T03:17:28.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 3 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: OPTIMIZED 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 3 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: OPTIMIZED 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:28.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:28 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: ], , client address: IPv4 10.20.193.97:58810 2026-02-18T03:17:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3325597239' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:28.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] INFO state.py:1684 (99): Start update from 10 to 11 (discovery-trial119). 2026-02-18T03:17:28.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] INFO state.py:2068 (99): Update complete (10 -> 11) (discovery-trial119). 2026-02-18T03:17:28.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.119:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:41646 2026-02-18T03:17:28.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:28.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode2_trial119_TCP_10.20.193.119_4420, OMAP version: 12 2026-02-18T03:17:28.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:28 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:28] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3325597239' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:28.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] INFO state.py:1684 (2): Start update from 10 to 11 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:28.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:28.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial119 2026-02-18T03:17:28.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] INFO state.py:2068 (2): Update complete (10 -> 11) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:28.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] INFO state.py:1684 (144): Start update from 10 to 11 (discovery-trial114). 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] INFO state.py:2068 (144): Update complete (10 -> 11) (discovery-trial114). 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:28] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 2 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: OPTIMIZED 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 4 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: OPTIMIZED 2026-02-18T03:17:28.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 2 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: OPTIMIZED 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 4 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: OPTIMIZED 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:28.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 2 2026-02-18T03:17:28.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: OPTIMIZED 2026-02-18T03:17:28.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:28.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:28.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 4 2026-02-18T03:17:28.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: OPTIMIZED 2026-02-18T03:17:28.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:28.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:28 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: ], , client address: IPv4 10.20.193.114:41744 2026-02-18T03:17:29.041 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 10.20.193.119:4420: Successful 2026-02-18T03:17:29.060 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:17:29.061 INFO:tasks.workunit.client.0.trial031.stderr:+ ip=10.20.193.194 2026-02-18T03:17:29.061 INFO:tasks.workunit.client.0.trial031.stderr:+ name=trial194 2026-02-18T03:17:29.061 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 3 2026-02-18T03:17:29.062 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:29.062 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:17:29.062 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.194 and name trial194' 2026-02-18T03:17:29.062 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.194 and name trial194 2026-02-18T03:17:29.063 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.194 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name trial194 --traddr 10.20.193.194 --trsvcid 4420 2026-02-18T03:17:29.112 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:29Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:29] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.119:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:50288 2026-02-18T03:17:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:29] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:29] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode3_trial119_TCP_10.20.193.119_4420, OMAP version: 13 2026-02-18T03:17:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.583 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 10.20.193.194:4420: Successful 2026-02-18T03:17:29.607 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:29.607 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:17:29.608 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.194 and name trial194 2026-02-18T03:17:29.608 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.194 and name trial194' 2026-02-18T03:17:29.608 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.194 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name trial194 --traddr 10.20.193.194 --trsvcid 4420 2026-02-18T03:17:29.640 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:29Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:29.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO state.py:1684 (2): Start update from 11 to 13 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:29.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:29.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial119 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial194 differs from requested host trial119 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO state.py:2068 (2): Update complete (11 -> 13) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO state.py:1684 (123): Start update from 11 to 13 (discovery-trial194). 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO state.py:2068 (123): Update complete (11 -> 13) (discovery-trial194). 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.194:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:54632 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:29.563544] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.194 port 4420 *** 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode1_trial194_TCP_10.20.193.194_4420, OMAP version: 14 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:29 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-mon[21799]: pgmap v97: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 36 KiB/s rd, 1.7 KiB/s wr, 46 op/s 2026-02-18T03:17:29.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] INFO state.py:1684 (81): Start update from 11 to 13 (discovery-trial097). 2026-02-18T03:17:29.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] INFO state.py:2068 (81): Update complete (11 -> 13) (discovery-trial097). 2026-02-18T03:17:29.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] INFO state.py:1684 (2): Start update from 11 to 13 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:29.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:29.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial119 2026-02-18T03:17:29.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:29.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial119 2026-02-18T03:17:29.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] INFO state.py:2068 (2): Update complete (11 -> 13) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:29.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:29 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-mon[24143]: pgmap v97: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 36 KiB/s rd, 1.7 KiB/s wr, 46 op/s 2026-02-18T03:17:29.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:29] INFO state.py:1684 (99): Start update from 11 to 13 (discovery-trial119). 2026-02-18T03:17:29.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:29] INFO state.py:2068 (99): Update complete (11 -> 13) (discovery-trial119). 2026-02-18T03:17:29.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:29] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:29 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-mon[23907]: pgmap v97: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 36 KiB/s rd, 1.7 KiB/s wr, 46 op/s 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] INFO state.py:1684 (2): Start update from 11 to 13 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial119 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] INFO grpc.py:6183 (2): Received request to create trial119 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.119:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial119 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] INFO state.py:2068 (2): Update complete (11 -> 13) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] INFO state.py:1684 (144): Start update from 11 to 13 (discovery-trial114). 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] INFO state.py:2068 (144): Update complete (11 -> 13) (discovery-trial114). 2026-02-18T03:17:29.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:29.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:29 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.086 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 10.20.193.194:4420: Successful 2026-02-18T03:17:30.106 INFO:tasks.workunit.client.0.trial031.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:30.106 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:17:30.106 INFO:tasks.workunit.client.0.trial031.stdout:Adding gateway listener with IP 10.20.193.194 and name trial194 2026-02-18T03:17:30.107 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Adding gateway listener with IP 10.20.193.194 and name trial194' 2026-02-18T03:17:30.107 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.194 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name trial194 --traddr 10.20.193.194 --trsvcid 4420 2026-02-18T03:17:30.141 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:30Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:30.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:30 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:30] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.194:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:57020 2026-02-18T03:17:30.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:30 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:30] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:30 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:30 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:30] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode2_trial194_TCP_10.20.193.194_4420, OMAP version: 15 2026-02-18T03:17:30.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:30.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:30 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:30] INFO state.py:1684 (123): Start update from 13 to 15 (discovery-trial194). 2026-02-18T03:17:30.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:30 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:30] INFO state.py:2068 (123): Update complete (13 -> 15) (discovery-trial194). 2026-02-18T03:17:30.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:30 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:30] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.194:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.31:46414 2026-02-18T03:17:30.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:30 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:17:30.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1709043693' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:30.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO state.py:1684 (81): Start update from 13 to 15 (discovery-trial097). 2026-02-18T03:17:30.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO state.py:2068 (81): Update complete (13 -> 15) (discovery-trial097). 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO state.py:1684 (2): Start update from 13 to 15 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial194 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial194 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO state.py:2068 (2): Update complete (13 -> 15) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:30] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 3 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: INACCESSIBLE 2026-02-18T03:17:30.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 3 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: INACCESSIBLE 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: states { 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: grp_id: 3 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: state: INACCESSIBLE 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: } 2026-02-18T03:17:30.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:30 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: ], , client address: IPv4 10.20.193.97:58854 2026-02-18T03:17:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1709043693' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:30.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] INFO state.py:1684 (99): Start update from 13 to 15 (discovery-trial119). 2026-02-18T03:17:30.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] INFO state.py:2068 (99): Update complete (13 -> 15) (discovery-trial119). 2026-02-18T03:17:30.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] INFO state.py:1684 (2): Start update from 13 to 15 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:30.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:30.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial194 2026-02-18T03:17:30.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:30.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial194 2026-02-18T03:17:30.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:30 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:30] INFO state.py:2068 (2): Update complete (13 -> 15) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1709043693' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:30.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] INFO state.py:1684 (144): Start update from 13 to 15 (discovery-trial114). 2026-02-18T03:17:30.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] INFO state.py:2068 (144): Update complete (13 -> 15) (discovery-trial114). 2026-02-18T03:17:30.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] INFO state.py:1684 (2): Start update from 13 to 15 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:30.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:30.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial194 2026-02-18T03:17:30.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:30.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial194 2026-02-18T03:17:30.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:30 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:30] INFO state.py:2068 (2): Update complete (13 -> 15) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:31.623 INFO:tasks.workunit.client.0.trial031.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 10.20.193.194:4420: Successful 2026-02-18T03:17:31.645 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 3 2026-02-18T03:17:31.646 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:31.647 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:17:31.647 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode1 --host '*' 2026-02-18T03:17:31.679 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:31Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:31.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:31 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:31] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 2 retries 2026-02-18T03:17:31.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:31 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:31] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode3_trial194_TCP_10.20.193.194_4420, OMAP version: 16 2026-02-18T03:17:31.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:31 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:31.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:31 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:31] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:31.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:31 trial097 ceph-mon[21799]: pgmap v98: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 33 KiB/s rd, 1.7 KiB/s wr, 42 op/s 2026-02-18T03:17:31.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:31 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:31] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:31.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:31 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:31.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:31 trial119 ceph-mon[24143]: pgmap v98: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 33 KiB/s rd, 1.7 KiB/s wr, 42 op/s 2026-02-18T03:17:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:31 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:31] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:31 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:31.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-mon[23907]: pgmap v98: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 33 KiB/s rd, 1.7 KiB/s wr, 42 op/s 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:31] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:31] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 4 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: INACCESSIBLE 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:31.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 4 2026-02-18T03:17:31.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: INACCESSIBLE 2026-02-18T03:17:31.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:31.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:17:31.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: states { 2026-02-18T03:17:31.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: grp_id: 4 2026-02-18T03:17:31.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: state: INACCESSIBLE 2026-02-18T03:17:31.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: } 2026-02-18T03:17:31.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:31 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: ], , client address: IPv4 10.20.193.114:41780 2026-02-18T03:17:32.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:32 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:32] INFO state.py:1684 (123): Start update from 15 to 16 (discovery-trial194). 2026-02-18T03:17:32.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:32 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:32] INFO state.py:2068 (123): Update complete (15 -> 16) (discovery-trial194). 2026-02-18T03:17:32.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: , client address: IPv4 10.20.193.31:57596 2026-02-18T03:17:32.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:32.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] WARNING state.py:688 (2): Local version 15 differs from OMAP file version 16. The file is not current, will reload it and try again 2026-02-18T03:17:32.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] WARNING state.py:1642 (2): An update is already running, ignore 2026-02-18T03:17:32.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO state.py:1684 (81): Start update from 15 to 16 (discovery-trial097). 2026-02-18T03:17:32.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO state.py:2068 (81): Update complete (15 -> 16) (discovery-trial097). 2026-02-18T03:17:32.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO state.py:1684 (2): Start update from 15 to 16 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:32.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:32.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial097 differs from requested host trial194 2026-02-18T03:17:32.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO state.py:2068 (2): Update complete (15 -> 16) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:17:32.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:32 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:32] INFO state.py:1684 (99): Start update from 15 to 16 (discovery-trial119). 2026-02-18T03:17:32.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:32 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:32] INFO state.py:2068 (99): Update complete (15 -> 16) (discovery-trial119). 2026-02-18T03:17:32.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:32 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:32] INFO state.py:1684 (2): Start update from 15 to 16 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:32.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:32 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:32] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:32.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:32 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:32] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial119 differs from requested host trial194 2026-02-18T03:17:32.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:32 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:32] INFO state.py:2068 (2): Update complete (15 -> 16) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:32.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:32 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:32] INFO state.py:1684 (144): Start update from 15 to 16 (discovery-trial114). 2026-02-18T03:17:32.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:32 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:32] INFO state.py:2068 (144): Update complete (15 -> 16) (discovery-trial114). 2026-02-18T03:17:32.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:32 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:32] INFO state.py:1684 (2): Start update from 15 to 16 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:32.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:32 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:32] INFO grpc.py:6183 (2): Received request to create trial194 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.194:4420, secure: False, verify host name: True, context: None 2026-02-18T03:17:32.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:32 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:32] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial114 differs from requested host trial194 2026-02-18T03:17:32.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:32 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:32] INFO state.py:2068 (2): Update complete (15 -> 16) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:32.622 INFO:tasks.workunit.client.0.trial031.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:32.623 INFO:tasks.workunit.client.0.trial031.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode1 might be a security breach 2026-02-18T03:17:32.649 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:32.649 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:17:32.649 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode2 --host '*' 2026-02-18T03:17:32.692 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:32Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:32.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:32 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:32] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:32.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:32 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:32.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: , client address: IPv4 10.20.193.31:57596 2026-02-18T03:17:32.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:32.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:32.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode1_*, OMAP version: 17 2026-02-18T03:17:32.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:32.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:32 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:32.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:32 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:32] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:32.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:32 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:32.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:32 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:32.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:32 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:32] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.154 INFO:tasks.workunit.client.0.trial031.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:33.154 INFO:tasks.workunit.client.0.trial031.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode2 might be a security breach 2026-02-18T03:17:33.178 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:33.178 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:17:33.178 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode3 --host '*' 2026-02-18T03:17:33.212 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:33Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:33.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO state.py:1684 (123): Start update from 16 to 17 (discovery-trial194). 2026-02-18T03:17:33.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO state.py:2068 (123): Update complete (16 -> 17) (discovery-trial194). 2026-02-18T03:17:33.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO state.py:1684 (2): Start update from 16 to 17 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:33.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:17:33.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO state.py:2068 (2): Update complete (16 -> 17) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:33.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO state.py:1684 (81): Start update from 16 to 17 (discovery-trial097). 2026-02-18T03:17:33.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO state.py:2068 (81): Update complete (16 -> 17) (discovery-trial097). 2026-02-18T03:17:33.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: , client address: IPv4 10.20.193.31:47782 2026-02-18T03:17:33.404 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:33.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode2_*, OMAP version: 18 2026-02-18T03:17:33.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO state.py:1684 (99): Start update from 16 to 17 (discovery-trial119). 2026-02-18T03:17:33.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO state.py:2068 (99): Update complete (16 -> 17) (discovery-trial119). 2026-02-18T03:17:33.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO state.py:1684 (2): Start update from 16 to 17 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO state.py:2068 (2): Update complete (16 -> 17) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: states { 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: grp_id: 3 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: state: OPTIMIZED 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: } 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: states { 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: grp_id: 3 2026-02-18T03:17:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: state: OPTIMIZED 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: } 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: states { 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: grp_id: 3 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: state: OPTIMIZED 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: } 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: ], , client address: IPv4 10.20.193.119:53948 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO state.py:1684 (2): Start update from 16 to 17 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:33.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:17:33.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO state.py:1684 (144): Start update from 16 to 17 (discovery-trial114). 2026-02-18T03:17:33.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO state.py:2068 (144): Update complete (16 -> 17) (discovery-trial114). 2026-02-18T03:17:33.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO state.py:2068 (2): Update complete (16 -> 17) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:33.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:33.639 INFO:tasks.workunit.client.0.trial031.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:17:33.639 INFO:tasks.workunit.client.0.trial031.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode3 might be a security breach 2026-02-18T03:17:33.656 INFO:tasks.workunit.client.0.trial031.stderr:+ image_index=1 2026-02-18T03:17:33.657 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 3 2026-02-18T03:17:33.658 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:33.658 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:17:33.658 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 20 2026-02-18T03:17:33.659 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:33.659 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage1 2026-02-18T03:17:33.659 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage1 --load-balancing-group 2 2026-02-18T03:17:33.683 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:33Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:33.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: , client address: IPv4 10.20.193.31:38138 2026-02-18T03:17:33.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode3_*, OMAP version: 19 2026-02-18T03:17:33.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO state.py:1684 (81): Start update from 17 to 19 (discovery-trial097). 2026-02-18T03:17:33.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO state.py:2068 (81): Update complete (17 -> 19) (discovery-trial097). 2026-02-18T03:17:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO state.py:1684 (99): Start update from 17 to 19 (discovery-trial119). 2026-02-18T03:17:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO state.py:2068 (99): Update complete (17 -> 19) (discovery-trial119). 2026-02-18T03:17:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO state.py:1684 (2): Start update from 17 to 19 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:17:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:17:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:33 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:33] INFO state.py:2068 (2): Update complete (17 -> 19) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:33.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO state.py:1684 (144): Start update from 17 to 19 (discovery-trial114). 2026-02-18T03:17:33.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO state.py:2068 (144): Update complete (17 -> 19) (discovery-trial114). 2026-02-18T03:17:33.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO state.py:1684 (2): Start update from 17 to 19 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:33.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:17:33.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:17:33.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:33.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:33 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:33] INFO state.py:2068 (2): Update complete (17 -> 19) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:34.064 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO state.py:1684 (123): Start update from 17 to 19 (discovery-trial194). 2026-02-18T03:17:34.065 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO state.py:2068 (123): Update complete (17 -> 19) (discovery-trial194). 2026-02-18T03:17:34.065 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO state.py:1684 (2): Start update from 17 to 19 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:34.065 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:17:34.065 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:34.065 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:17:34.065 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:17:34.065 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:33 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:33] INFO state.py:2068 (2): Update complete (17 -> 19) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:34.065 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.154 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:34.175 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:34.175 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:34.175 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage2 2026-02-18T03:17:34.175 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage2 --load-balancing-group 3 2026-02-18T03:17:34.216 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:34Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:34.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-mon[21799]: pgmap v99: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 70 KiB/s rd, 2.8 KiB/s wr, 76 op/s 2026-02-18T03:17:34.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/726635229' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:34.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:44296 2026-02-18T03:17:34.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage1, no need to remove 2026-02-18T03:17:34.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:34.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:33 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:33] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:34.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:44296 2026-02-18T03:17:34.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.041024] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.97:0/1734694262, rc 0 2026-02-18T03:17:34.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.041102] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.97:0/1734694262 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.97:0/1734694262' 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.050777] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO grpc.py:2517 (2): Received request to add bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: , client address: IPv4 10.20.193.31:44296 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.055450] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.055677] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.055692] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_1, OMAP version: 20 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.150651] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:34.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.150679] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:34.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-mon[24143]: pgmap v99: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 70 KiB/s rd, 2.8 KiB/s wr, 76 op/s 2026-02-18T03:17:34.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/726635229' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-mon[23907]: pgmap v99: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 70 KiB/s rd, 2.8 KiB/s wr, 76 op/s 2026-02-18T03:17:34.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/726635229' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:34.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO state.py:1684 (81): Start update from 19 to 20 (discovery-trial097). 2026-02-18T03:17:34.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO state.py:2068 (81): Update complete (19 -> 20) (discovery-trial097). 2026-02-18T03:17:34.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:57858 2026-02-18T03:17:34.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage2, no need to remove 2026-02-18T03:17:34.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:34.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:34.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:57858 2026-02-18T03:17:34.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.711486] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.97:0/2192525272, rc 0 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.711551] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.97:0/2192525272 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.97:0/2192525272' 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.721850] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO grpc.py:2517 (2): Received request to add bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: , client address: IPv4 10.20.193.31:57858 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.726614] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.726634] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_2, OMAP version: 21 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.822598] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:34.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:34 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:34.822623] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:34.827 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:34.845 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:34.845 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:34.845 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage3 2026-02-18T03:17:34.845 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage3 --load-balancing-group 4 2026-02-18T03:17:34.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] INFO state.py:1684 (2): Start update from 19 to 20 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:34.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:34.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:34.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] INFO state.py:1684 (123): Start update from 19 to 20 (discovery-trial194). 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] INFO state.py:2068 (123): Update complete (19 -> 20) (discovery-trial194). 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:34.621923] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.194:0/2289020744, rc 0 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:34.621994] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.194:0/2289020744 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.194:0/2289020744' 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:34.630607] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] INFO grpc.py:2517 (2): Received request to add bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:34.635180] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:34.635405] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:34.635423] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] INFO state.py:2068 (2): Update complete (19 -> 20) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:34.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:34 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.889 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:34Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] INFO state.py:1684 (2): Start update from 19 to 20 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] INFO state.py:1684 (99): Start update from 19 to 20 (discovery-trial119). 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] INFO state.py:2068 (99): Update complete (19 -> 20) (discovery-trial119). 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:34.609587] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.119:0/3139083633, rc 0 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:34.609661] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.119:0/3139083633 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.119:0/3139083633' 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:34.619509] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] INFO grpc.py:2517 (2): Received request to add bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:34.624142] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:34.624378] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:17:34.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:34.624393] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:17:34.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] INFO state.py:2068 (2): Update complete (19 -> 20) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:34.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:34 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] INFO state.py:1684 (144): Start update from 19 to 20 (discovery-trial114). 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] INFO state.py:2068 (144): Update complete (19 -> 20) (discovery-trial114). 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] INFO state.py:1684 (2): Start update from 19 to 20 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:34.618980] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.114:0/2586318474, rc 0 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:34.619057] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.114:0/2586318474 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.114:0/2586318474' 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:34.628383] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:34.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] INFO grpc.py:2517 (2): Received request to add bdev_59d8fdeb-81ca-4749-862d-efb3916482f4 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:17:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:34.633011] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:17:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:34.633264] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:17:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:34.633279] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:17:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] INFO state.py:2068 (2): Update complete (19 -> 20) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:34.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:34 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:34] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:35.442 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: states { 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: grp_id: 4 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: state: OPTIMIZED 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: } 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: states { 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: grp_id: 4 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: state: OPTIMIZED 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: } 2026-02-18T03:17:35.443 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: states { 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: grp_id: 4 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: state: OPTIMIZED 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: } 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: ], , client address: IPv4 10.20.193.194:33756 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO state.py:1684 (123): Start update from 20 to 21 (discovery-trial194). 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO state.py:2068 (123): Update complete (20 -> 21) (discovery-trial194). 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO state.py:1684 (2): Start update from 20 to 21 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.267843] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.194:0/1747529663, rc 0 2026-02-18T03:17:35.444 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.267923] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.194:0/1747529663 2026-02-18T03:17:35.445 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.194:0/1747529663' 2026-02-18T03:17:35.445 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.276974] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:35.445 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:2517 (2): Received request to add bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:17:35.445 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.281645] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:17:35.445 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.281667] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:17:35.445 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO state.py:2068 (2): Update complete (20 -> 21) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:35.445 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO state.py:1684 (81): Start update from 20 to 21 (discovery-trial097). 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO state.py:2068 (81): Update complete (20 -> 21) (discovery-trial097). 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:57388 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage3, no need to remove 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:57388 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:35.419098] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.97:0/797367366, rc 0 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:35.419385] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.97:0/797367366 2026-02-18T03:17:35.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.97:0/797367366' 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:35.429690] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO grpc.py:2517 (2): Received request to add bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: , client address: IPv4 10.20.193.31:57388 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:35.434108] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:35.434129] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_3, OMAP version: 22 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:35.530158] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:35.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:35.530188] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:35.534 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:35.556 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:35.556 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:35.556 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage4 2026-02-18T03:17:35.556 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage4 --load-balancing-group 1 2026-02-18T03:17:35.589 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:35.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO state.py:1684 (99): Start update from 20 to 21 (discovery-trial119). 2026-02-18T03:17:35.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO state.py:2068 (99): Update complete (20 -> 21) (discovery-trial119). 2026-02-18T03:17:35.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO state.py:1684 (2): Start update from 20 to 21 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:35.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.267970] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.119:0/946241911, rc 0 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.268033] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.119:0/946241911 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.119:0/946241911' 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.277660] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO grpc.py:2517 (2): Received request to add bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.282479] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.282500] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO state.py:2068 (2): Update complete (20 -> 21) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:35.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:35.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO state.py:1684 (2): Start update from 20 to 21 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:35.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:35.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:35.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO state.py:1684 (144): Start update from 20 to 21 (discovery-trial114). 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO state.py:2068 (144): Update complete (20 -> 21) (discovery-trial114). 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.260807] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.114:0/2137757137, rc 0 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.260868] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.114:0/2137757137 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.114:0/2137757137' 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.270171] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO grpc.py:2517 (2): Received request to add bdev_d15cbedb-4459-4426-aa52-1c947faae1d2 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.275429] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.275449] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO state.py:2068 (2): Update complete (20 -> 21) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:35.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.040 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO state.py:1684 (81): Start update from 21 to 22 (discovery-trial097). 2026-02-18T03:17:36.040 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:35 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:35] INFO state.py:2068 (81): Update complete (21 -> 22) (discovery-trial097). 2026-02-18T03:17:36.040 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:56242 2026-02-18T03:17:36.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-mon[24143]: pgmap v100: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 58 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO state.py:1684 (99): Start update from 21 to 22 (discovery-trial119). 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO state.py:2068 (99): Update complete (21 -> 22) (discovery-trial119). 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO state.py:1684 (2): Start update from 21 to 22 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.974129] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.119:0/3677577403, rc 0 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.974187] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.119:0/3677577403 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.119:0/3677577403' 2026-02-18T03:17:36.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.984341] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:36.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:35] INFO grpc.py:2517 (2): Received request to add bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:17:36.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.988737] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:17:36.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:35 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:35.988759] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:17:36.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO state.py:2068 (2): Update complete (21 -> 22) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:36.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-mon[23907]: pgmap v100: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 58 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO state.py:1684 (144): Start update from 21 to 22 (discovery-trial114). 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO state.py:2068 (144): Update complete (21 -> 22) (discovery-trial114). 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO state.py:1684 (2): Start update from 21 to 22 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.974960] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.114:0/2618124794, rc 0 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.975020] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.114:0/2618124794 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.114:0/2618124794' 2026-02-18T03:17:36.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.985783] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:36.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:35] INFO grpc.py:2517 (2): Received request to add bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:17:36.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.990353] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:17:36.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:35 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:35.990373] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:17:36.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO state.py:2068 (2): Update complete (21 -> 22) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:36.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.238 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-mon[21799]: pgmap v100: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 58 KiB/s rd, 2.0 KiB/s wr, 58 op/s 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage4, no need to remove 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:56242 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.130143] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.97:0/548427732, rc 0 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.130209] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.97:0/548427732 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.97:0/548427732' 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.140391] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:36.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO grpc.py:2517 (2): Received request to add bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: , client address: IPv4 10.20.193.31:56242 2026-02-18T03:17:36.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.144898] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:17:36.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.144920] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:17:36.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_4, OMAP version: 23 2026-02-18T03:17:36.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.237362] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:36.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.237393] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:36.242 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:36.262 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:36.262 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:36.262 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage5 2026-02-18T03:17:36.262 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage5 --load-balancing-group 2 2026-02-18T03:17:36.301 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:36Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:36.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO state.py:1684 (123): Start update from 21 to 22 (discovery-trial194). 2026-02-18T03:17:36.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO state.py:2068 (123): Update complete (21 -> 22) (discovery-trial194). 2026-02-18T03:17:36.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO state.py:1684 (2): Start update from 21 to 22 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:36.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.974123] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.194:0/3824511220, rc 0 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.974178] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.194:0/3824511220 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.194:0/3824511220' 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.985175] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:35] INFO grpc.py:2517 (2): Received request to add bdev_762e9fa0-adee-4afb-8c7f-d89d3acc24fb to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.989713] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:35 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:35.989733] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO state.py:2068 (2): Update complete (21 -> 22) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO state.py:1684 (81): Start update from 22 to 23 (discovery-trial097). 2026-02-18T03:17:36.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO state.py:2068 (81): Update complete (22 -> 23) (discovery-trial097). 2026-02-18T03:17:36.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:42706 2026-02-18T03:17:36.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage5, no need to remove 2026-02-18T03:17:36.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:36.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:36.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:42706 2026-02-18T03:17:36.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.825392] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.97:0/2851964788, rc 0 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.825457] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.97:0/2851964788 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.97:0/2851964788' 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.835391] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO grpc.py:2517 (2): Received request to add bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: , client address: IPv4 10.20.193.31:42706 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.839953] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.839981] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_5, OMAP version: 24 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:36] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.938919] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:36.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:36 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:36.938950] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:36.943 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:36.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO state.py:1684 (99): Start update from 22 to 23 (discovery-trial119). 2026-02-18T03:17:36.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO state.py:2068 (99): Update complete (22 -> 23) (discovery-trial119). 2026-02-18T03:17:36.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO state.py:1684 (2): Start update from 22 to 23 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:36.684506] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.119:0/2826313181, rc 0 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:36.684736] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.119:0/2826313181 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.119:0/2826313181' 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:36.694619] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO grpc.py:2517 (2): Received request to add bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:36.699311] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:36.699333] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] INFO state.py:2068 (2): Update complete (22 -> 23) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:36 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:36] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.965 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:36.965 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:36.965 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage6 2026-02-18T03:17:36.966 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage6 --load-balancing-group 3 2026-02-18T03:17:36.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO state.py:1684 (2): Start update from 22 to 23 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO state.py:1684 (144): Start update from 22 to 23 (discovery-trial114). 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO state.py:2068 (144): Update complete (22 -> 23) (discovery-trial114). 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:36.677878] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.114:0/410358602, rc 0 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:36.677953] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.114:0/410358602 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.114:0/410358602' 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:36.687959] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO grpc.py:2517 (2): Received request to add bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:36.692535] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:17:36.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:36.692558] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:17:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] INFO state.py:2068 (2): Update complete (22 -> 23) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:36 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.008 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:37Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:37.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO state.py:1684 (123): Start update from 22 to 23 (discovery-trial194). 2026-02-18T03:17:37.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO state.py:2068 (123): Update complete (22 -> 23) (discovery-trial194). 2026-02-18T03:17:37.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO state.py:1684 (2): Start update from 22 to 23 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:37.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:36.686159] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.194:0/970277767, rc 0 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:36.686218] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.194:0/970277767 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.194:0/970277767' 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:36.695833] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO grpc.py:2517 (2): Received request to add bdev_d23f48ee-a16b-4bb0-a487-b57ed81425cf to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:36.700357] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:36.700380] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] INFO state.py:2068 (2): Update complete (22 -> 23) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:36 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.359 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/4282800737' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:37.443 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/4282800737' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:37.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] INFO state.py:1684 (2): Start update from 23 to 24 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] INFO state.py:1684 (99): Start update from 23 to 24 (discovery-trial119). 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] INFO state.py:2068 (99): Update complete (23 -> 24) (discovery-trial119). 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:37.375047] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.119:0/2909170626, rc 0 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:37.375113] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.119:0/2909170626 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.119:0/2909170626' 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:37.384464] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] INFO grpc.py:2517 (2): Received request to add bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:17:37.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:37.388967] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:17:37.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:37.388991] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:17:37.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] INFO state.py:2068 (2): Update complete (23 -> 24) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:37.447 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/4282800737' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] INFO state.py:1684 (144): Start update from 23 to 24 (discovery-trial114). 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] INFO state.py:2068 (144): Update complete (23 -> 24) (discovery-trial114). 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] INFO state.py:1684 (2): Start update from 23 to 24 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:37.380342] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.114:0/2947554495, rc 0 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:37.380414] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.114:0/2947554495 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.114:0/2947554495' 2026-02-18T03:17:37.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:37.390254] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:37.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] INFO grpc.py:2517 (2): Received request to add bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:17:37.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:37.394773] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:17:37.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:37.394796] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:17:37.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] INFO state.py:2068 (2): Update complete (23 -> 24) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:37.622 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:37.625 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO state.py:1684 (81): Start update from 23 to 24 (discovery-trial097). 2026-02-18T03:17:37.625 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO state.py:2068 (81): Update complete (23 -> 24) (discovery-trial097). 2026-02-18T03:17:37.625 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:52194 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage6, no need to remove 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7d8ef647-ce9e-4872-8254-4e1598616889 from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:52194 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:37.515633] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.97:0/2431932671, rc 0 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:37.516382] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.97:0/2431932671 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.97:0/2431932671' 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:37.525394] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7d8ef647-ce9e-4872-8254-4e1598616889 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO grpc.py:2517 (2): Received request to add bdev_7d8ef647-ce9e-4872-8254-4e1598616889 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: , client address: IPv4 10.20.193.31:52194 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:37.530001] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:17:37.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:37.530025] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:17:37.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_6, OMAP version: 25 2026-02-18T03:17:37.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:37] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:37.623847] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:37.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:37 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:37.623878] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:37.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] INFO state.py:1684 (123): Start update from 23 to 24 (discovery-trial194). 2026-02-18T03:17:37.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] INFO state.py:2068 (123): Update complete (23 -> 24) (discovery-trial194). 2026-02-18T03:17:37.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] INFO state.py:1684 (2): Start update from 23 to 24 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:37.380443] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.194:0/3153144440, rc 0 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:37.381465] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.194:0/3153144440 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.194:0/3153144440' 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:37.399474] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] INFO grpc.py:2517 (2): Received request to add bdev_1cbacfee-f144-4873-ae41-9abc07d2db1b to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:37.404032] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:37.404053] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] INFO state.py:2068 (2): Update complete (23 -> 24) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:37 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:37] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.642 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:37.642 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:37.643 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage7 2026-02-18T03:17:37.643 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage7 --load-balancing-group 4 2026-02-18T03:17:37.684 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:37Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:37.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:37 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:37] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:37 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.300 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:38.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO state.py:1684 (2): Start update from 24 to 25 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:38.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7d8ef647-ce9e-4872-8254-4e1598616889 from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO state.py:1684 (123): Start update from 24 to 25 (discovery-trial194). 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO state.py:2068 (123): Update complete (24 -> 25) (discovery-trial194). 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.068601] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.194:0/1915369647, rc 0 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.068660] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.194:0/1915369647 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.194:0/1915369647' 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.078227] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7d8ef647-ce9e-4872-8254-4e1598616889 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO grpc.py:2517 (2): Received request to add bdev_7d8ef647-ce9e-4872-8254-4e1598616889 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:17:38.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.083270] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:17:38.383 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.083291] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:17:38.383 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO state.py:2068 (2): Update complete (24 -> 25) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:38.383 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.383 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-mon[21799]: pgmap v101: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 207 KiB/s rd, 2.5 KiB/s wr, 234 op/s 2026-02-18T03:17:38.405 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/4238423001' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:38.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO state.py:1684 (81): Start update from 24 to 25 (discovery-trial097). 2026-02-18T03:17:38.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO state.py:2068 (81): Update complete (24 -> 25) (discovery-trial097). 2026-02-18T03:17:38.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:40272 2026-02-18T03:17:38.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage7, no need to remove 2026-02-18T03:17:38.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_4b327665-6c32-49aa-a743-267fd011763e from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:40272 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.195826] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.97:0/2904648800, rc 0 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.195884] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.97:0/2904648800 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.97:0/2904648800' 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.205102] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_4b327665-6c32-49aa-a743-267fd011763e rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO grpc.py:2517 (2): Received request to add bdev_4b327665-6c32-49aa-a743-267fd011763e to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: , client address: IPv4 10.20.193.31:40272 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.209735] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.209755] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_7, OMAP version: 26 2026-02-18T03:17:38.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.407 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.407 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.295602] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:38.407 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.295626] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:38.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-mon[24143]: pgmap v101: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 207 KiB/s rd, 2.5 KiB/s wr, 234 op/s 2026-02-18T03:17:38.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/4238423001' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO state.py:1684 (2): Start update from 24 to 25 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7d8ef647-ce9e-4872-8254-4e1598616889 from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO state.py:1684 (99): Start update from 24 to 25 (discovery-trial119). 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO state.py:2068 (99): Update complete (24 -> 25) (discovery-trial119). 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.068602] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.119:0/3287864055, rc 0 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.068660] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.119:0/3287864055 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.119:0/3287864055' 2026-02-18T03:17:38.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.077400] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7d8ef647-ce9e-4872-8254-4e1598616889 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:38.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO grpc.py:2517 (2): Received request to add bdev_7d8ef647-ce9e-4872-8254-4e1598616889 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:17:38.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.082186] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:17:38.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.082207] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:17:38.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO state.py:2068 (2): Update complete (24 -> 25) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:38.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-mon[23907]: pgmap v101: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 207 KiB/s rd, 2.5 KiB/s wr, 234 op/s 2026-02-18T03:17:38.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/4238423001' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO state.py:1684 (144): Start update from 24 to 25 (discovery-trial114). 2026-02-18T03:17:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO state.py:2068 (144): Update complete (24 -> 25) (discovery-trial114). 2026-02-18T03:17:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO state.py:1684 (2): Start update from 24 to 25 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7d8ef647-ce9e-4872-8254-4e1598616889 from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.066638] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.114:0/1285306457, rc 0 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.066744] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.114:0/1285306457 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.114:0/1285306457' 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.075004] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7d8ef647-ce9e-4872-8254-4e1598616889 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO grpc.py:2517 (2): Received request to add bdev_7d8ef647-ce9e-4872-8254-4e1598616889 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.079973] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.079995] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO state.py:2068 (2): Update complete (24 -> 25) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:38.538 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:38.538 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:38.538 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage8 2026-02-18T03:17:38.539 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage8 --load-balancing-group 1 2026-02-18T03:17:38.613 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:38Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:39.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO state.py:1684 (81): Start update from 25 to 26 (discovery-trial097). 2026-02-18T03:17:39.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO state.py:2068 (81): Update complete (25 -> 26) (discovery-trial097). 2026-02-18T03:17:39.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:44016 2026-02-18T03:17:39.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage8, no need to remove 2026-02-18T03:17:39.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:44016 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.939882] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.97:0/3671759746, rc 0 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.939964] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.97:0/3671759746 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.97:0/3671759746' 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.948961] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO grpc.py:2517 (2): Received request to add bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: , client address: IPv4 10.20.193.31:44016 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.953355] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:38.953374] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_8, OMAP version: 27 2026-02-18T03:17:39.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.037 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:38 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:38] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.037 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.033235] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:39.037 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.033259] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:39.037 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:39.063 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:39.064 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:39.064 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage9 2026-02-18T03:17:39.064 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage9 --load-balancing-group 2 2026-02-18T03:17:39.098 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:39.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO state.py:1684 (2): Start update from 25 to 26 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:39.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:39.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_4b327665-6c32-49aa-a743-267fd011763e from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO state.py:1684 (123): Start update from 25 to 26 (discovery-trial194). 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO state.py:2068 (123): Update complete (25 -> 26) (discovery-trial194). 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.747724] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.194:0/2918887763, rc 0 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.747784] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.194:0/2918887763 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.194:0/2918887763' 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.757582] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_4b327665-6c32-49aa-a743-267fd011763e rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO grpc.py:2517 (2): Received request to add bdev_4b327665-6c32-49aa-a743-267fd011763e to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.762256] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:38.762280] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] INFO state.py:2068 (2): Update complete (25 -> 26) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:39.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:38 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.164 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO state.py:1684 (99): Start update from 25 to 26 (discovery-trial119). 2026-02-18T03:17:39.164 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO state.py:2068 (99): Update complete (25 -> 26) (discovery-trial119). 2026-02-18T03:17:39.164 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO state.py:1684 (2): Start update from 25 to 26 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:39.164 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:39.164 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_4b327665-6c32-49aa-a743-267fd011763e from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.749713] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.119:0/22443098, rc 0 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.749778] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.119:0/22443098 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.119:0/22443098' 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.759925] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_4b327665-6c32-49aa-a743-267fd011763e rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO grpc.py:2517 (2): Received request to add bdev_4b327665-6c32-49aa-a743-267fd011763e to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.764545] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:38.764564] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] INFO state.py:2068 (2): Update complete (25 -> 26) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.165 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO state.py:1684 (144): Start update from 25 to 26 (discovery-trial114). 2026-02-18T03:17:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO state.py:2068 (144): Update complete (25 -> 26) (discovery-trial114). 2026-02-18T03:17:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO state.py:1684 (2): Start update from 25 to 26 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_4b327665-6c32-49aa-a743-267fd011763e from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.747835] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.114:0/3165919923, rc 0 2026-02-18T03:17:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.748231] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.114:0/3165919923 2026-02-18T03:17:39.166 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.114:0/3165919923' 2026-02-18T03:17:39.167 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.766229] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_4b327665-6c32-49aa-a743-267fd011763e rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:39.167 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO grpc.py:2517 (2): Received request to add bdev_4b327665-6c32-49aa-a743-267fd011763e to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:17:39.167 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.771266] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:17:39.167 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:38.771291] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:17:39.167 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] INFO state.py:2068 (2): Update complete (25 -> 26) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:39.167 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.167 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:38 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:38] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3395301502' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:39.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3395301502' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:39.469 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3395301502' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:39.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] INFO state.py:1684 (2): Start update from 26 to 27 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:39.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:39.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:39.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] INFO state.py:1684 (144): Start update from 26 to 27 (discovery-trial114). 2026-02-18T03:17:39.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] INFO state.py:2068 (144): Update complete (26 -> 27) (discovery-trial114). 2026-02-18T03:17:39.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:39.490911] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.114:0/2276185474, rc 0 2026-02-18T03:17:39.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:39.490970] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.114:0/2276185474 2026-02-18T03:17:39.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.114:0/2276185474' 2026-02-18T03:17:39.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:39.500286] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:39.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] INFO grpc.py:2517 (2): Received request to add bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:17:39.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:39.504969] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:17:39.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:39.504989] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:17:39.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] INFO state.py:2068 (2): Update complete (26 -> 27) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:39.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:39 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:39] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO state.py:1684 (81): Start update from 26 to 27 (discovery-trial097). 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO state.py:2068 (81): Update complete (26 -> 27) (discovery-trial097). 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:56458 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage9, no need to remove 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f666e601-6ace-4568-b983-772d73d63ee9 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:56458 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.641134] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.97:0/4022341488, rc 0 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.641193] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.97:0/4022341488 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.97:0/4022341488' 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.651386] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f666e601-6ace-4568-b983-772d73d63ee9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:39.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO grpc.py:2517 (2): Received request to add bdev_f666e601-6ace-4568-b983-772d73d63ee9 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: , client address: IPv4 10.20.193.31:56458 2026-02-18T03:17:39.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.658560] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:17:39.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.658582] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:17:39.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_9, OMAP version: 28 2026-02-18T03:17:39.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:39] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.741931] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:39.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:39.741958] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:39.746 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:39.768 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:39.768 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:39.769 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage10 2026-02-18T03:17:39.769 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage10 --load-balancing-group 3 2026-02-18T03:17:39.807 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:39.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] INFO state.py:1684 (123): Start update from 26 to 27 (discovery-trial194). 2026-02-18T03:17:39.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] INFO state.py:2068 (123): Update complete (26 -> 27) (discovery-trial194). 2026-02-18T03:17:39.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] INFO state.py:1684 (2): Start update from 26 to 27 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:39.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:39.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:39.494530] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.194:0/4170390893, rc 0 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:39.495473] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.194:0/4170390893 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.194:0/4170390893' 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:39.505203] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] INFO grpc.py:2517 (2): Received request to add bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:39.509774] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:39.509794] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] INFO state.py:2068 (2): Update complete (26 -> 27) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:39 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] INFO state.py:1684 (99): Start update from 26 to 27 (discovery-trial119). 2026-02-18T03:17:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] INFO state.py:2068 (99): Update complete (26 -> 27) (discovery-trial119). 2026-02-18T03:17:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] INFO state.py:1684 (2): Start update from 26 to 27 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:39.496224] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.119:0/2783631949, rc 0 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:39.496288] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.119:0/2783631949 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.119:0/2783631949' 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:39.506970] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] INFO grpc.py:2517 (2): Received request to add bdev_2c97f4a8-7f90-4258-acdc-2099e9094eb6 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:39.511379] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:39.511400] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] INFO state.py:2068 (2): Update complete (26 -> 27) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:39 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:40.437 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-mon[21799]: pgmap v102: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 327 KiB/s rd, 4.0 KiB/s wr, 354 op/s 2026-02-18T03:17:40.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO state.py:1684 (81): Start update from 27 to 28 (discovery-trial097). 2026-02-18T03:17:40.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO state.py:2068 (81): Update complete (27 -> 28) (discovery-trial097). 2026-02-18T03:17:40.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:33684 2026-02-18T03:17:40.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage10, no need to remove 2026-02-18T03:17:40.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:40.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:33684 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:40.334014] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.97:0/132741106, rc 0 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:40.334087] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.97:0/132741106 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.97:0/132741106' 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:40.343898] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO grpc.py:2517 (2): Received request to add bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: , client address: IPv4 10.20.193.31:33684 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:40.348437] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:40.348458] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_10, OMAP version: 29 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:40.439 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:40.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:40.436360] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:40.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:40.436388] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:40.440 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:40.462 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:40.462 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:40.462 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage11 2026-02-18T03:17:40.462 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage11 --load-balancing-group 4 2026-02-18T03:17:40.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-mon[24143]: pgmap v102: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 327 KiB/s rd, 4.0 KiB/s wr, 354 op/s 2026-02-18T03:17:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO state.py:1684 (99): Start update from 27 to 28 (discovery-trial119). 2026-02-18T03:17:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO state.py:2068 (99): Update complete (27 -> 28) (discovery-trial119). 2026-02-18T03:17:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO state.py:1684 (2): Start update from 27 to 28 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f666e601-6ace-4568-b983-772d73d63ee9 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.195128] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.119:0/368162111, rc 0 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.195193] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.119:0/368162111 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.119:0/368162111' 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.205710] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f666e601-6ace-4568-b983-772d73d63ee9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO grpc.py:2517 (2): Received request to add bdev_f666e601-6ace-4568-b983-772d73d63ee9 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.210354] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.210374] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO state.py:2068 (2): Update complete (27 -> 28) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:40.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-mon[23907]: pgmap v102: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 327 KiB/s rd, 4.0 KiB/s wr, 354 op/s 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO state.py:1684 (2): Start update from 27 to 28 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f666e601-6ace-4568-b983-772d73d63ee9 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO state.py:1684 (144): Start update from 27 to 28 (discovery-trial114). 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO state.py:2068 (144): Update complete (27 -> 28) (discovery-trial114). 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.188480] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.114:0/4039288497, rc 0 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.198231] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.114:0/4039288497 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.114:0/4039288497' 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.208203] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f666e601-6ace-4568-b983-772d73d63ee9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO grpc.py:2517 (2): Received request to add bdev_f666e601-6ace-4568-b983-772d73d63ee9 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:17:40.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.212718] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:17:40.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.212738] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:17:40.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO state.py:2068 (2): Update complete (27 -> 28) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:40.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:40.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:40.509 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:40.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO state.py:1684 (123): Start update from 27 to 28 (discovery-trial194). 2026-02-18T03:17:40.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO state.py:2068 (123): Update complete (27 -> 28) (discovery-trial194). 2026-02-18T03:17:40.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO state.py:1684 (2): Start update from 27 to 28 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:40.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:40.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f666e601-6ace-4568-b983-772d73d63ee9 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.194272] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.194:0/210477275, rc 0 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.194332] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.194:0/210477275 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.194:0/210477275' 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.203571] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f666e601-6ace-4568-b983-772d73d63ee9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO grpc.py:2517 (2): Received request to add bdev_f666e601-6ace-4568-b983-772d73d63ee9 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.208096] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.208121] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO state.py:2068 (2): Update complete (27 -> 28) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:40.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.118 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:41.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO state.py:1684 (2): Start update from 28 to 29 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:41.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:41.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:41.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO state.py:1684 (123): Start update from 28 to 29 (discovery-trial194). 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO state.py:2068 (123): Update complete (28 -> 29) (discovery-trial194). 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.908462] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.194:0/1782622242, rc 0 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.908525] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.194:0/1782622242 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.194:0/1782622242' 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.919493] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO grpc.py:2517 (2): Received request to add bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.924065] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:40.924085] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:40 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:40] INFO state.py:2068 (2): Update complete (28 -> 29) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.139 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:41.139 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:41.139 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage12 2026-02-18T03:17:41.139 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage12 --load-balancing-group 1 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO state.py:1684 (81): Start update from 28 to 29 (discovery-trial097). 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO state.py:2068 (81): Update complete (28 -> 29) (discovery-trial097). 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:37870 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage11, no need to remove 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:37870 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.008398] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.97:0/2414055994, rc 0 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.008453] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.97:0/2414055994 2026-02-18T03:17:41.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.97:0/2414055994' 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.018014] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO grpc.py:2517 (2): Received request to add bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: , client address: IPv4 10.20.193.31:37870 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.022557] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.022580] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_11, OMAP version: 30 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.113835] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:41.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.113860] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:41.168 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO state.py:1684 (99): Start update from 28 to 29 (discovery-trial119). 2026-02-18T03:17:41.168 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO state.py:2068 (99): Update complete (28 -> 29) (discovery-trial119). 2026-02-18T03:17:41.168 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO state.py:1684 (2): Start update from 28 to 29 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.910210] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.119:0/357762513, rc 0 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.910734] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.119:0/357762513 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.119:0/357762513' 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.926734] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO grpc.py:2517 (2): Received request to add bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.931895] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:40.931915] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:40 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:40] INFO state.py:2068 (2): Update complete (28 -> 29) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:41.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.170 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.170 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO state.py:1684 (2): Start update from 28 to 29 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:41.170 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:41.170 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:41.170 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO state.py:1684 (144): Start update from 28 to 29 (discovery-trial114). 2026-02-18T03:17:41.170 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO state.py:2068 (144): Update complete (28 -> 29) (discovery-trial114). 2026-02-18T03:17:41.170 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.908380] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.114:0/2190486530, rc 0 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.908439] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.114:0/2190486530 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.114:0/2190486530' 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.918776] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO grpc.py:2517 (2): Received request to add bdev_70d52d75-ee98-4a5f-a50a-b5a51311d2d5 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.923291] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:40.923310] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:40 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:40] INFO state.py:2068 (2): Update complete (28 -> 29) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.171 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.181 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:41.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/398165979' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:41.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/398165979' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:41.540 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/398165979' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:41.859 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO state.py:1684 (81): Start update from 29 to 30 (discovery-trial097). 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO state.py:2068 (81): Update complete (29 -> 30) (discovery-trial097). 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:47530 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage12, no need to remove 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:47530 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.714420] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.97:0/255604795, rc 0 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.715395] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.97:0/255604795 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.97:0/255604795' 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.732392] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:41.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO grpc.py:2517 (2): Received request to add bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: , client address: IPv4 10.20.193.31:47530 2026-02-18T03:17:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.758619] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:17:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.758650] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:17:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_12, OMAP version: 31 2026-02-18T03:17:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:41] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.857889] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:41.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:41 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:41.857917] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:41.862 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:41.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] INFO state.py:1684 (2): Start update from 29 to 30 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:41.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:41.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:41.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] INFO state.py:1684 (123): Start update from 29 to 30 (discovery-trial194). 2026-02-18T03:17:41.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] INFO state.py:2068 (123): Update complete (29 -> 30) (discovery-trial194). 2026-02-18T03:17:41.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:41.560207] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.194:0/431124084, rc 0 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:41.560264] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.194:0/431124084 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.194:0/431124084' 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:41.569404] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] INFO grpc.py:2517 (2): Received request to add bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:41.574709] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:41.574730] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] INFO state.py:2068 (2): Update complete (29 -> 30) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:41 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.886 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:41.887 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:41.887 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage13 2026-02-18T03:17:41.887 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage13 --load-balancing-group 2 2026-02-18T03:17:41.925 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] INFO state.py:1684 (99): Start update from 29 to 30 (discovery-trial119). 2026-02-18T03:17:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] INFO state.py:2068 (99): Update complete (29 -> 30) (discovery-trial119). 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] INFO state.py:1684 (2): Start update from 29 to 30 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:41.562819] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.119:0/926462520, rc 0 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:41.562888] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.119:0/926462520 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.119:0/926462520' 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:41.572694] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] INFO grpc.py:2517 (2): Received request to add bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:41.577459] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:41.577480] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:17:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] INFO state.py:2068 (2): Update complete (29 -> 30) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:41.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:41 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] INFO state.py:1684 (2): Start update from 29 to 30 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] INFO state.py:1684 (144): Start update from 29 to 30 (discovery-trial114). 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] INFO state.py:2068 (144): Update complete (29 -> 30) (discovery-trial114). 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:41.555194] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.114:0/3467250885, rc 0 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:41.555258] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.114:0/3467250885 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.114:0/3467250885' 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:41.564113] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] INFO grpc.py:2517 (2): Received request to add bdev_7bd8a4a4-0e62-4569-ab83-70a6e4a4d46c to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:41.568833] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:17:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:41.568857] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:17:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] INFO state.py:2068 (2): Update complete (29 -> 30) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:41 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.439 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-mon[21799]: pgmap v103: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 505 KiB/s rd, 3.8 KiB/s wr, 574 op/s 2026-02-18T03:17:42.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO state.py:1684 (81): Start update from 30 to 31 (discovery-trial097). 2026-02-18T03:17:42.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO state.py:2068 (81): Update complete (30 -> 31) (discovery-trial097). 2026-02-18T03:17:42.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:47476 2026-02-18T03:17:42.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage13, no need to remove 2026-02-18T03:17:42.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:42.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:42.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_75ff3243-60af-4a49-aad5-e93854373045 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:47476 2026-02-18T03:17:42.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:42.438370] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.97:0/863382989, rc 0 2026-02-18T03:17:42.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:42.438434] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.97:0/863382989 2026-02-18T03:17:42.461 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-mon[23907]: pgmap v103: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 505 KiB/s rd, 3.8 KiB/s wr, 574 op/s 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO state.py:1684 (144): Start update from 30 to 31 (discovery-trial114). 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO state.py:1684 (2): Start update from 30 to 31 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO state.py:2068 (144): Update complete (30 -> 31) (discovery-trial114). 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:42.296422] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.114:0/1971548053, rc 0 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:42.296496] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.114:0/1971548053 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.114:0/1971548053' 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:42.306797] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:42.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO grpc.py:2517 (2): Received request to add bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:17:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:42.311960] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:17:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:42.311984] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:17:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO state.py:2068 (2): Update complete (30 -> 31) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-mon[24143]: pgmap v103: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 505 KiB/s rd, 3.8 KiB/s wr, 574 op/s 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO state.py:1684 (99): Start update from 30 to 31 (discovery-trial119). 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO state.py:2068 (99): Update complete (30 -> 31) (discovery-trial119). 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO state.py:1684 (2): Start update from 30 to 31 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:42.296995] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.119:0/2007007512, rc 0 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:42.297060] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.119:0/2007007512 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.119:0/2007007512' 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:42.307111] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:42.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO grpc.py:2517 (2): Received request to add bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:17:42.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:42.311677] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:17:42.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:42.311700] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:17:42.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO state.py:2068 (2): Update complete (30 -> 31) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:42.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.554 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:42.575 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:42.575 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:42.575 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage14 2026-02-18T03:17:42.575 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage14 --load-balancing-group 3 2026-02-18T03:17:42.608 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:42Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:42.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO state.py:1684 (123): Start update from 30 to 31 (discovery-trial194). 2026-02-18T03:17:42.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO state.py:2068 (123): Update complete (30 -> 31) (discovery-trial194). 2026-02-18T03:17:42.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO state.py:1684 (2): Start update from 30 to 31 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:42.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:42.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:42.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:42.298921] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.194:0/236203671, rc 0 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:42.303469] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.194:0/236203671 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.194:0/236203671' 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:42.322478] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO grpc.py:2517 (2): Received request to add bdev_3a7234c7-854c-4537-82b0-62672c7e72f9 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:42.327178] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:42.327207] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO state.py:2068 (2): Update complete (30 -> 31) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.97:0/863382989' 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:42.448242] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_75ff3243-60af-4a49-aad5-e93854373045 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO grpc.py:2517 (2): Received request to add bdev_75ff3243-60af-4a49-aad5-e93854373045 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: , client address: IPv4 10.20.193.31:47476 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:42.452679] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:42.452702] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_13, OMAP version: 32 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:42.550430] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:42.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:42.550458] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:43.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1246734805' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:43.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO state.py:1684 (2): Start update from 31 to 32 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:43.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:43.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_75ff3243-60af-4a49-aad5-e93854373045 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:43.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO state.py:1684 (144): Start update from 31 to 32 (discovery-trial114). 2026-02-18T03:17:43.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO state.py:2068 (144): Update complete (31 -> 32) (discovery-trial114). 2026-02-18T03:17:43.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:42.991608] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.114:0/381942054, rc 0 2026-02-18T03:17:43.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:42.991677] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.114:0/381942054 2026-02-18T03:17:43.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:42 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.114:0/381942054' 2026-02-18T03:17:43.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:43.000680] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_75ff3243-60af-4a49-aad5-e93854373045 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:43.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO grpc.py:2517 (2): Received request to add bdev_75ff3243-60af-4a49-aad5-e93854373045 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:17:43.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:43.005435] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:17:43.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:43.005458] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:17:43.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO state.py:2068 (2): Update complete (31 -> 32) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:43.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.261 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1246734805' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO state.py:1684 (81): Start update from 31 to 32 (discovery-trial097). 2026-02-18T03:17:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:42 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:42] INFO state.py:2068 (81): Update complete (31 -> 32) (discovery-trial097). 2026-02-18T03:17:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:47974 2026-02-18T03:17:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage14, no need to remove 2026-02-18T03:17:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:47974 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.154343] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.97:0/1430564817, rc 0 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.154411] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.97:0/1430564817 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.97:0/1430564817' 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.164846] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO grpc.py:2517 (2): Received request to add bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: , client address: IPv4 10.20.193.31:47974 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.169358] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.169380] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_14, OMAP version: 33 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.260299] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.260334] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:43.264 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:43.290 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:43.290 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:43.290 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage15 2026-02-18T03:17:43.290 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage15 --load-balancing-group 4 2026-02-18T03:17:43.323 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:43Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO state.py:1684 (2): Start update from 31 to 32 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_75ff3243-60af-4a49-aad5-e93854373045 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO state.py:1684 (123): Start update from 31 to 32 (discovery-trial194). 2026-02-18T03:17:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO state.py:2068 (123): Update complete (31 -> 32) (discovery-trial194). 2026-02-18T03:17:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:42.991421] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.194:0/369258916, rc 0 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:42.992474] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.194:0/369258916 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:42 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.194:0/369258916' 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:43.002371] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_75ff3243-60af-4a49-aad5-e93854373045 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO grpc.py:2517 (2): Received request to add bdev_75ff3243-60af-4a49-aad5-e93854373045 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:43.006895] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:43.006916] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO state.py:2068 (2): Update complete (31 -> 32) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1246734805' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:43.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO state.py:1684 (99): Start update from 31 to 32 (discovery-trial119). 2026-02-18T03:17:43.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO state.py:2068 (99): Update complete (31 -> 32) (discovery-trial119). 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO state.py:1684 (2): Start update from 31 to 32 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_75ff3243-60af-4a49-aad5-e93854373045 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:42.995344] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.119:0/3152784980, rc 0 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:42.995408] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.119:0/3152784980 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:42 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.119:0/3152784980' 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:43.004899] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_75ff3243-60af-4a49-aad5-e93854373045 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO grpc.py:2517 (2): Received request to add bdev_75ff3243-60af-4a49-aad5-e93854373045 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:43.009276] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:43.009298] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:17:43.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO state.py:2068 (2): Update complete (31 -> 32) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:43.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO state.py:1684 (81): Start update from 32 to 33 (discovery-trial097). 2026-02-18T03:17:43.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO state.py:2068 (81): Update complete (32 -> 33) (discovery-trial097). 2026-02-18T03:17:43.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:54426 2026-02-18T03:17:43.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage15, no need to remove 2026-02-18T03:17:43.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:43.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:43.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:54426 2026-02-18T03:17:43.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.845251] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.97:0/546502087, rc 0 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.845326] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.97:0/546502087 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.97:0/546502087' 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.854947] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO grpc.py:2517 (2): Received request to add bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: , client address: IPv4 10.20.193.31:54426 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.859444] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.859470] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_15, OMAP version: 34 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:43] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.945098] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:43.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:43 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:43.945125] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:43.949 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:43.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO state.py:1684 (2): Start update from 32 to 33 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:43.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:43.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO state.py:1684 (99): Start update from 32 to 33 (discovery-trial119). 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO state.py:2068 (99): Update complete (32 -> 33) (discovery-trial119). 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:43.700892] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.119:0/3177574766, rc 0 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:43.700953] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.119:0/3177574766 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.119:0/3177574766' 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:43.711581] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO grpc.py:2517 (2): Received request to add bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:43.716116] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:43.716137] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] INFO state.py:2068 (2): Update complete (32 -> 33) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:43 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.973 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:43.973 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:43.974 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage16 2026-02-18T03:17:43.974 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage16 --load-balancing-group 1 2026-02-18T03:17:43.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO state.py:1684 (144): Start update from 32 to 33 (discovery-trial114). 2026-02-18T03:17:43.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO state.py:2068 (144): Update complete (32 -> 33) (discovery-trial114). 2026-02-18T03:17:43.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO state.py:1684 (2): Start update from 32 to 33 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:43.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:43.708658] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.114:0/1998021310, rc 0 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:43.708722] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.114:0/1998021310 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.114:0/1998021310' 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:43.718890] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO grpc.py:2517 (2): Received request to add bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:43.723551] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:43.723572] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] INFO state.py:2068 (2): Update complete (32 -> 33) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:43.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:43 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.016 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:44Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:44.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO state.py:1684 (123): Start update from 32 to 33 (discovery-trial194). 2026-02-18T03:17:44.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO state.py:2068 (123): Update complete (32 -> 33) (discovery-trial194). 2026-02-18T03:17:44.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO state.py:1684 (2): Start update from 32 to 33 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:44.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:44.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:44.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:43.710916] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.194:0/1763341747, rc 0 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:43.710973] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.194:0/1763341747 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.194:0/1763341747' 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:43.721466] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO grpc.py:2517 (2): Received request to add bdev_0eb6f0a8-ae69-44b2-91ec-115ba62556ad to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:43.725972] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:43.725994] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] INFO state.py:2068 (2): Update complete (32 -> 33) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:43 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.378 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-mon[21799]: pgmap v104: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 729 KiB/s rd, 5.5 KiB/s wr, 794 op/s 2026-02-18T03:17:44.462 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-mon[24143]: pgmap v104: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 729 KiB/s rd, 5.5 KiB/s wr, 794 op/s 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] INFO state.py:1684 (99): Start update from 33 to 34 (discovery-trial119). 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] INFO state.py:1684 (2): Start update from 33 to 34 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] INFO state.py:2068 (99): Update complete (33 -> 34) (discovery-trial119). 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:44.395838] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.119:0/3044245149, rc 0 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:44.395896] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.119:0/3044245149 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.119:0/3044245149' 2026-02-18T03:17:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:44.405526] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] INFO grpc.py:2517 (2): Received request to add bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:17:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:44.410056] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:17:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:44.410078] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:17:44.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] INFO state.py:2068 (2): Update complete (33 -> 34) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:44.467 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-mon[23907]: pgmap v104: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 729 KiB/s rd, 5.5 KiB/s wr, 794 op/s 2026-02-18T03:17:44.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] INFO state.py:1684 (144): Start update from 33 to 34 (discovery-trial114). 2026-02-18T03:17:44.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] INFO state.py:2068 (144): Update complete (33 -> 34) (discovery-trial114). 2026-02-18T03:17:44.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] INFO state.py:1684 (2): Start update from 33 to 34 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:44.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:44.398993] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.114:0/2126073357, rc 0 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:44.399048] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.114:0/2126073357 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.114:0/2126073357' 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:44.409330] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] INFO grpc.py:2517 (2): Received request to add bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:44.414185] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:44.414209] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:17:44.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] INFO state.py:2068 (2): Update complete (33 -> 34) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:44.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] INFO state.py:1684 (123): Start update from 33 to 34 (discovery-trial194). 2026-02-18T03:17:44.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] INFO state.py:2068 (123): Update complete (33 -> 34) (discovery-trial194). 2026-02-18T03:17:44.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] INFO state.py:1684 (2): Start update from 33 to 34 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:44.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:44.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:44.402316] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.194:0/3924995027, rc 0 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:44.402375] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.194:0/3924995027 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.194:0/3924995027' 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:44.412474] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] INFO grpc.py:2517 (2): Received request to add bdev_ea61bfc9-efd5-4e2d-966b-a523b42e61af to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:44.417038] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:44.417059] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] INFO state.py:2068 (2): Update complete (33 -> 34) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:44 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO state.py:1684 (81): Start update from 33 to 34 (discovery-trial097). 2026-02-18T03:17:44.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO state.py:2068 (81): Update complete (33 -> 34) (discovery-trial097). 2026-02-18T03:17:44.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:56592 2026-02-18T03:17:44.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage16, no need to remove 2026-02-18T03:17:44.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:44.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:44.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_324b67de-dc7e-408d-85c9-88eef881eb5c from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:56592 2026-02-18T03:17:44.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:44.537195] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.97:0/4257103137, rc 0 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:44.537263] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.97:0/4257103137 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.97:0/4257103137' 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:44.546697] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_324b67de-dc7e-408d-85c9-88eef881eb5c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO grpc.py:2517 (2): Received request to add bdev_324b67de-dc7e-408d-85c9-88eef881eb5c to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: , client address: IPv4 10.20.193.31:56592 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:44.551476] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:44.551499] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_16, OMAP version: 35 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:44] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:44.640369] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:44.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:44 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:44.640398] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:44.644 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:44.666 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:44.666 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:44.667 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage17 2026-02-18T03:17:44.667 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage17 --load-balancing-group 2 2026-02-18T03:17:44.700 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:44Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:44 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:44 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:44] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:45.333 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2307522390' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:45.333 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO state.py:1684 (81): Start update from 34 to 35 (discovery-trial097). 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO state.py:2068 (81): Update complete (34 -> 35) (discovery-trial097). 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:37692 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage17, no need to remove 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:37692 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.232343] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.97:0/746937103, rc 0 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.232429] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.97:0/746937103 2026-02-18T03:17:45.334 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.97:0/746937103' 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.241643] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO grpc.py:2517 (2): Received request to add bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: , client address: IPv4 10.20.193.31:37692 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.246261] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.246285] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_17, OMAP version: 36 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.331714] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:45.335 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.331740] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:45.336 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:45.360 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:45.360 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:45.360 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage18 2026-02-18T03:17:45.360 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage18 --load-balancing-group 3 2026-02-18T03:17:45.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO state.py:1684 (123): Start update from 34 to 35 (discovery-trial194). 2026-02-18T03:17:45.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO state.py:2068 (123): Update complete (34 -> 35) (discovery-trial194). 2026-02-18T03:17:45.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO state.py:1684 (2): Start update from 34 to 35 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:45.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:45.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_324b67de-dc7e-408d-85c9-88eef881eb5c from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:45.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.089181] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.194:0/3366262869, rc 0 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.089240] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.194:0/3366262869 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.194:0/3366262869' 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.098407] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_324b67de-dc7e-408d-85c9-88eef881eb5c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO grpc.py:2517 (2): Received request to add bdev_324b67de-dc7e-408d-85c9-88eef881eb5c to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.102952] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.102976] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO state.py:2068 (2): Update complete (34 -> 35) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:45.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:45.392 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:45Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:45.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2307522390' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO state.py:1684 (99): Start update from 34 to 35 (discovery-trial119). 2026-02-18T03:17:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO state.py:2068 (99): Update complete (34 -> 35) (discovery-trial119). 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO state.py:1684 (2): Start update from 34 to 35 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_324b67de-dc7e-408d-85c9-88eef881eb5c from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.093592] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.119:0/3742736635, rc 0 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.093655] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.119:0/3742736635 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.119:0/3742736635' 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.103264] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_324b67de-dc7e-408d-85c9-88eef881eb5c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO grpc.py:2517 (2): Received request to add bdev_324b67de-dc7e-408d-85c9-88eef881eb5c to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.108091] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.108113] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:17:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO state.py:2068 (2): Update complete (34 -> 35) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:45.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2307522390' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO state.py:1684 (2): Start update from 34 to 35 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_324b67de-dc7e-408d-85c9-88eef881eb5c from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO state.py:1684 (144): Start update from 34 to 35 (discovery-trial114). 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO state.py:2068 (144): Update complete (34 -> 35) (discovery-trial114). 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.085327] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.114:0/81956055, rc 0 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.085384] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.114:0/81956055 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.114:0/81956055' 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.094727] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_324b67de-dc7e-408d-85c9-88eef881eb5c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO grpc.py:2517 (2): Received request to add bdev_324b67de-dc7e-408d-85c9-88eef881eb5c to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:17:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.099460] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:17:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.099484] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:17:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO state.py:2068 (2): Update complete (34 -> 35) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.010 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:46.032 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:46.032 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:46.032 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage19 2026-02-18T03:17:46.032 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage19 --load-balancing-group 4 2026-02-18T03:17:46.061 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:46Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:46.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO state.py:1684 (123): Start update from 35 to 36 (discovery-trial194). 2026-02-18T03:17:46.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO state.py:2068 (123): Update complete (35 -> 36) (discovery-trial194). 2026-02-18T03:17:46.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO state.py:1684 (2): Start update from 35 to 36 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:46.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:46.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:46.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.787085] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.194:0/1027174070, rc 0 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.787144] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.194:0/1027174070 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.194:0/1027174070' 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.796213] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO grpc.py:2517 (2): Received request to add bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.800974] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:45.800997] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] INFO state.py:2068 (2): Update complete (35 -> 36) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:45 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:45] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO state.py:1684 (81): Start update from 35 to 36 (discovery-trial097). 2026-02-18T03:17:46.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO state.py:2068 (81): Update complete (35 -> 36) (discovery-trial097). 2026-02-18T03:17:46.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:42066 2026-02-18T03:17:46.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage18, no need to remove 2026-02-18T03:17:46.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:46.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:46.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fd353615-3bed-4108-b88f-09951a89618b from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:42066 2026-02-18T03:17:46.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.903969] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.97:0/1938297192, rc 0 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.904050] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.97:0/1938297192 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.97:0/1938297192' 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.913215] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fd353615-3bed-4108-b88f-09951a89618b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO grpc.py:2517 (2): Received request to add bdev_fd353615-3bed-4108-b88f-09951a89618b to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: , client address: IPv4 10.20.193.31:42066 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.917664] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:45.917684] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_18, OMAP version: 37 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:45] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.006496] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:46.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.006524] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:46.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO state.py:1684 (99): Start update from 35 to 36 (discovery-trial119). 2026-02-18T03:17:46.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO state.py:2068 (99): Update complete (35 -> 36) (discovery-trial119). 2026-02-18T03:17:46.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO state.py:1684 (2): Start update from 35 to 36 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:46.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:46.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:46.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.783671] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.119:0/601095262, rc 0 2026-02-18T03:17:46.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.783732] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.119:0/601095262 2026-02-18T03:17:46.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.119:0/601095262' 2026-02-18T03:17:46.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.793494] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:46.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO grpc.py:2517 (2): Received request to add bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:17:46.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.798533] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:17:46.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:45.798554] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:17:46.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] INFO state.py:2068 (2): Update complete (35 -> 36) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:46.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:45 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO state.py:1684 (2): Start update from 35 to 36 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO state.py:1684 (144): Start update from 35 to 36 (discovery-trial114). 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO state.py:2068 (144): Update complete (35 -> 36) (discovery-trial114). 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.786956] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.114:0/111737046, rc 0 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.787018] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.114:0/111737046 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.114:0/111737046' 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.799233] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO grpc.py:2517 (2): Received request to add bdev_cc3ef717-a53b-4a9a-af4e-b96e7d4af711 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:17:46.185 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.819429] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:17:46.186 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:45.819459] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:17:46.186 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] INFO state.py:2068 (2): Update complete (35 -> 36) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:46.186 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.186 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:45 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:45] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.434 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2001616317' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:46.435 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-mon[23907]: pgmap v105: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 799 KiB/s rd, 4.7 KiB/s wr, 889 op/s 2026-02-18T03:17:46.435 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2001616317' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:46.436 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-mon[24143]: pgmap v105: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 799 KiB/s rd, 4.7 KiB/s wr, 889 op/s 2026-02-18T03:17:46.438 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2001616317' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:46.438 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-mon[21799]: pgmap v105: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 799 KiB/s rd, 4.7 KiB/s wr, 889 op/s 2026-02-18T03:17:46.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO state.py:1684 (81): Start update from 36 to 37 (discovery-trial097). 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO state.py:2068 (81): Update complete (36 -> 37) (discovery-trial097). 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:60502 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage19, no need to remove 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:60502 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.606520] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.97:0/3198951800, rc 0 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.607396] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.97:0/3198951800 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.97:0/3198951800' 2026-02-18T03:17:46.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.616795] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:46.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO grpc.py:2517 (2): Received request to add bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: , client address: IPv4 10.20.193.31:60502 2026-02-18T03:17:46.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.621354] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:17:46.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.621376] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:17:46.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_19, OMAP version: 38 2026-02-18T03:17:46.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:46] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.708824] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:46.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:46.708850] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:46.713 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:46.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] INFO state.py:1684 (99): Start update from 36 to 37 (discovery-trial119). 2026-02-18T03:17:46.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] INFO state.py:2068 (99): Update complete (36 -> 37) (discovery-trial119). 2026-02-18T03:17:46.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] INFO state.py:1684 (2): Start update from 36 to 37 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:46.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fd353615-3bed-4108-b88f-09951a89618b from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:46.462293] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.119:0/812595698, rc 0 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:46.462356] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.119:0/812595698 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.119:0/812595698' 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:46.471657] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fd353615-3bed-4108-b88f-09951a89618b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] INFO grpc.py:2517 (2): Received request to add bdev_fd353615-3bed-4108-b88f-09951a89618b to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:46.476275] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:46.476298] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] INFO state.py:2068 (2): Update complete (36 -> 37) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:46 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] INFO state.py:1684 (2): Start update from 36 to 37 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fd353615-3bed-4108-b88f-09951a89618b from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] INFO state.py:1684 (144): Start update from 36 to 37 (discovery-trial114). 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] INFO state.py:2068 (144): Update complete (36 -> 37) (discovery-trial114). 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:46.455518] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.114:0/3189598501, rc 0 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:46.468236] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.114:0/3189598501 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.114:0/3189598501' 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:46.477326] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fd353615-3bed-4108-b88f-09951a89618b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] INFO grpc.py:2517 (2): Received request to add bdev_fd353615-3bed-4108-b88f-09951a89618b to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:17:46.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:46.481723] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:17:46.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:46.481746] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:17:46.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] INFO state.py:2068 (2): Update complete (36 -> 37) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:46.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:46 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:46] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.734 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:46.734 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:46.734 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage20 2026-02-18T03:17:46.734 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage20 --load-balancing-group 1 2026-02-18T03:17:46.773 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:46Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:46.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] INFO state.py:1684 (2): Start update from 36 to 37 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:46.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:46.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fd353615-3bed-4108-b88f-09951a89618b from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:46.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] INFO state.py:1684 (123): Start update from 36 to 37 (discovery-trial194). 2026-02-18T03:17:46.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] INFO state.py:2068 (123): Update complete (36 -> 37) (discovery-trial194). 2026-02-18T03:17:46.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:46.457384] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.194:0/111236690, rc 0 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:46.457445] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.194:0/111236690 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.194:0/111236690' 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:46.467532] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fd353615-3bed-4108-b88f-09951a89618b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] INFO grpc.py:2517 (2): Received request to add bdev_fd353615-3bed-4108-b88f-09951a89618b to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:46.471916] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:46.471935] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] INFO state.py:2068 (2): Update complete (36 -> 37) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:46.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:46 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:46] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:47.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO state.py:1684 (81): Start update from 37 to 38 (discovery-trial097). 2026-02-18T03:17:47.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO state.py:2068 (81): Update complete (37 -> 38) (discovery-trial097). 2026-02-18T03:17:47.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:51124 2026-02-18T03:17:47.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage20, no need to remove 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_27b99663-df57-4418-82d0-29c16d2e3afd from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:51124 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:47.288964] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.97:0/1765723255, rc 0 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:47.289029] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.97:0/1765723255 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.97:0/1765723255' 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:47.298925] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_27b99663-df57-4418-82d0-29c16d2e3afd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO grpc.py:2517 (2): Received request to add bdev_27b99663-df57-4418-82d0-29c16d2e3afd to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: , client address: IPv4 10.20.193.31:51124 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:47.303579] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:47.303601] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:17:47.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_20, OMAP version: 39 2026-02-18T03:17:47.403 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:47.403 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:47.403 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:47.399300] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:47.403 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:47.399327] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:47.403 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:17:47.428 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:47.428 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:17:47.429 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:17:47.429 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 20 2026-02-18T03:17:47.430 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:47.430 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage21 2026-02-18T03:17:47.430 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage21 --load-balancing-group 2 2026-02-18T03:17:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO state.py:1684 (99): Start update from 37 to 38 (discovery-trial119). 2026-02-18T03:17:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO state.py:2068 (99): Update complete (37 -> 38) (discovery-trial119). 2026-02-18T03:17:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO state.py:1684 (2): Start update from 37 to 38 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.159931] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.119:0/1422787052, rc 0 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.159999] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.119:0/1422787052 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.119:0/1422787052' 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.170136] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO grpc.py:2517 (2): Received request to add bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.174748] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.174772] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO state.py:2068 (2): Update complete (37 -> 38) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:47.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:47.467 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:47Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:47.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO state.py:1684 (2): Start update from 37 to 38 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO state.py:1684 (144): Start update from 37 to 38 (discovery-trial114). 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO state.py:2068 (144): Update complete (37 -> 38) (discovery-trial114). 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.161374] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.114:0/340597219, rc 0 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.161441] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.114:0/340597219 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.114:0/340597219' 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.174234] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO grpc.py:2517 (2): Received request to add bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:17:47.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.185423] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:17:47.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.185445] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:17:47.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO state.py:2068 (2): Update complete (37 -> 38) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:47.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:47.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:47.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO state.py:1684 (2): Start update from 37 to 38 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:47.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO state.py:1684 (123): Start update from 37 to 38 (discovery-trial194). 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO state.py:2068 (123): Update complete (37 -> 38) (discovery-trial194). 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.159825] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.194:0/2656389282, rc 0 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.159878] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.194:0/2656389282 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.194:0/2656389282' 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.170625] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO grpc.py:2517 (2): Received request to add bdev_d8d1834d-49f0-4bac-a2bd-072c411f4c0a to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.175262] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.175281] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:17:47.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO state.py:2068 (2): Update complete (37 -> 38) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:47.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:47.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO state.py:1684 (123): Start update from 38 to 39 (discovery-trial194). 2026-02-18T03:17:48.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO state.py:2068 (123): Update complete (38 -> 39) (discovery-trial194). 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO state.py:1684 (2): Start update from 38 to 39 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_27b99663-df57-4418-82d0-29c16d2e3afd from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.843372] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.194:0/1485954595, rc 0 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.843427] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.194:0/1485954595 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.194:0/1485954595' 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.853643] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_27b99663-df57-4418-82d0-29c16d2e3afd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO grpc.py:2517 (2): Received request to add bdev_27b99663-df57-4418-82d0-29c16d2e3afd to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.858215] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:47.858234] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:17:48.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:47 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:47] INFO state.py:2068 (2): Update complete (38 -> 39) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:48.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO state.py:1684 (81): Start update from 38 to 39 (discovery-trial097). 2026-02-18T03:17:48.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO state.py:2068 (81): Update complete (38 -> 39) (discovery-trial097). 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:33638 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage21, no need to remove 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:47 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:47] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:33638 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.023275] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.97:0/1808162335, rc 0 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.023337] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.97:0/1808162335 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.97:0/1808162335' 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.033153] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO grpc.py:2517 (2): Received request to add bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: , client address: IPv4 10.20.193.31:33638 2026-02-18T03:17:48.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.037874] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:17:48.143 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.037897] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:17:48.143 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_1, OMAP version: 40 2026-02-18T03:17:48.143 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.143 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.143 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.139790] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:48.143 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.139817] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:48.144 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:48.168 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:48.168 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:48.168 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage22 2026-02-18T03:17:48.168 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage22 --load-balancing-group 3 2026-02-18T03:17:48.213 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:48Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO state.py:1684 (2): Start update from 38 to 39 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_27b99663-df57-4418-82d0-29c16d2e3afd from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO state.py:1684 (99): Start update from 38 to 39 (discovery-trial119). 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO state.py:2068 (99): Update complete (38 -> 39) (discovery-trial119). 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.846398] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.119:0/2017935801, rc 0 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.846470] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.119:0/2017935801 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.119:0/2017935801' 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.855492] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_27b99663-df57-4418-82d0-29c16d2e3afd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO grpc.py:2517 (2): Received request to add bdev_27b99663-df57-4418-82d0-29c16d2e3afd to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:17:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.859978] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:17:48.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:47.860003] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:17:48.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:47 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:47] INFO state.py:2068 (2): Update complete (38 -> 39) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:48.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO state.py:1684 (2): Start update from 38 to 39 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_27b99663-df57-4418-82d0-29c16d2e3afd from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO state.py:1684 (144): Start update from 38 to 39 (discovery-trial114). 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO state.py:2068 (144): Update complete (38 -> 39) (discovery-trial114). 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.843004] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.114:0/611694389, rc 0 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.843083] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.114:0/611694389 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.114:0/611694389' 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.852443] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_27b99663-df57-4418-82d0-29c16d2e3afd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:48.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO grpc.py:2517 (2): Received request to add bdev_27b99663-df57-4418-82d0-29c16d2e3afd to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:17:48.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.857017] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:17:48.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:47.857039] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:17:48.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:47 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:47] INFO state.py:2068 (2): Update complete (38 -> 39) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:48.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-mon[21799]: pgmap v106: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 953 KiB/s rd, 5.2 KiB/s wr, 1.08k op/s 2026-02-18T03:17:48.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/746141348' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:48.554 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-mon[23907]: pgmap v106: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 953 KiB/s rd, 5.2 KiB/s wr, 1.08k op/s 2026-02-18T03:17:48.554 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/746141348' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:48.555 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-mon[24143]: pgmap v106: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 953 KiB/s rd, 5.2 KiB/s wr, 1.08k op/s 2026-02-18T03:17:48.555 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/746141348' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:48.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO state.py:1684 (81): Start update from 39 to 40 (discovery-trial097). 2026-02-18T03:17:48.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO state.py:2068 (81): Update complete (39 -> 40) (discovery-trial097). 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:44724 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage22, no need to remove 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:44724 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.740080] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.97:0/659158945, rc 0 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.740404] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.97:0/659158945 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.97:0/659158945' 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.749655] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:48.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO grpc.py:2517 (2): Received request to add bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: , client address: IPv4 10.20.193.31:44724 2026-02-18T03:17:48.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.754751] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:17:48.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.754772] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:17:48.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_2, OMAP version: 41 2026-02-18T03:17:48.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:48] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.844672] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:48.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:48 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:48.844698] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:48.849 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:48.871 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:48.871 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:48.871 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage23 2026-02-18T03:17:48.871 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage23 --load-balancing-group 4 2026-02-18T03:17:48.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] INFO state.py:1684 (123): Start update from 39 to 40 (discovery-trial194). 2026-02-18T03:17:48.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] INFO state.py:2068 (123): Update complete (39 -> 40) (discovery-trial194). 2026-02-18T03:17:48.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] INFO state.py:1684 (2): Start update from 39 to 40 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:48.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:48.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:48.582387] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.194:0/810156265, rc 0 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:48.582453] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.194:0/810156265 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.194:0/810156265' 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:48.592002] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] INFO grpc.py:2517 (2): Received request to add bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:48.596811] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:48.596832] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] INFO state.py:2068 (2): Update complete (39 -> 40) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:48 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:48] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.916 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:48Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] INFO state.py:1684 (99): Start update from 39 to 40 (discovery-trial119). 2026-02-18T03:17:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] INFO state.py:2068 (99): Update complete (39 -> 40) (discovery-trial119). 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] INFO state.py:1684 (2): Start update from 39 to 40 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:48.576177] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.119:0/4260295399, rc 0 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:48.576249] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.119:0/4260295399 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.119:0/4260295399' 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:48.585349] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] INFO grpc.py:2517 (2): Received request to add bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:48.590089] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:48.590114] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:17:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] INFO state.py:2068 (2): Update complete (39 -> 40) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:48 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:48] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] INFO state.py:1684 (2): Start update from 39 to 40 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] INFO state.py:1684 (144): Start update from 39 to 40 (discovery-trial114). 2026-02-18T03:17:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] INFO state.py:2068 (144): Update complete (39 -> 40) (discovery-trial114). 2026-02-18T03:17:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:48.576665] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.114:0/3638520884, rc 0 2026-02-18T03:17:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:48.576727] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.114:0/3638520884 2026-02-18T03:17:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.114:0/3638520884' 2026-02-18T03:17:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:48.586581] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] INFO grpc.py:2517 (2): Received request to add bdev_746f0480-d6b0-43bb-a7fd-23fafd464af3 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:17:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:48.591269] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:17:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:48.591292] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:17:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] INFO state.py:2068 (2): Update complete (39 -> 40) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:48 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO state.py:1684 (81): Start update from 40 to 41 (discovery-trial097). 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO state.py:2068 (81): Update complete (40 -> 41) (discovery-trial097). 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:43368 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage23, no need to remove 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_355d0258-04fb-4112-9ca1-344e8abfd619 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:43368 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:49.428969] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.97:0/2231500239, rc 0 2026-02-18T03:17:49.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:49.429037] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.97:0/2231500239 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.97:0/2231500239' 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:49.438911] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_355d0258-04fb-4112-9ca1-344e8abfd619 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO grpc.py:2517 (2): Received request to add bdev_355d0258-04fb-4112-9ca1-344e8abfd619 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: , client address: IPv4 10.20.193.31:43368 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:49.443353] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:49.443375] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_3, OMAP version: 42 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:49.541984] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:49.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:49.542014] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:49.546 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:49.568 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:49.568 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:49.569 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage24 2026-02-18T03:17:49.569 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage24 --load-balancing-group 1 2026-02-18T03:17:49.608 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:49Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:49.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO state.py:1684 (2): Start update from 40 to 41 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:49.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:49.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:49.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO state.py:1684 (123): Start update from 40 to 41 (discovery-trial194). 2026-02-18T03:17:49.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO state.py:2068 (123): Update complete (40 -> 41) (discovery-trial194). 2026-02-18T03:17:49.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.292994] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.194:0/844847728, rc 0 2026-02-18T03:17:49.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.293061] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.194:0/844847728 2026-02-18T03:17:49.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.194:0/844847728' 2026-02-18T03:17:49.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.302574] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:49.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO grpc.py:2517 (2): Received request to add bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:17:49.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.307723] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:17:49.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.307742] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:17:49.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO state.py:2068 (2): Update complete (40 -> 41) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:49.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:49.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:49.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO state.py:1684 (2): Start update from 40 to 41 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:49.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO state.py:1684 (99): Start update from 40 to 41 (discovery-trial119). 2026-02-18T03:17:49.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO state.py:2068 (99): Update complete (40 -> 41) (discovery-trial119). 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:49.297790] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.119:0/3327810918, rc 0 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:49.297849] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.119:0/3327810918 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.119:0/3327810918' 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:49.307637] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO grpc.py:2517 (2): Received request to add bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:49.312760] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:17:49.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:49.312780] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:17:49.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO state.py:2068 (2): Update complete (40 -> 41) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:49.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:49.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO state.py:1684 (144): Start update from 40 to 41 (discovery-trial114). 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO state.py:2068 (144): Update complete (40 -> 41) (discovery-trial114). 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO state.py:1684 (2): Start update from 40 to 41 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.298997] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.114:0/3649715963, rc 0 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.299235] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.114:0/3649715963 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.114:0/3649715963' 2026-02-18T03:17:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.316233] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO grpc.py:2517 (2): Received request to add bdev_c4752690-7ff9-42b1-8b0a-5342b982fbef to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:17:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.342430] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:17:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.342459] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:17:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO state.py:2068 (2): Update complete (40 -> 41) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO state.py:1684 (99): Start update from 41 to 42 (discovery-trial119). 2026-02-18T03:17:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO state.py:2068 (99): Update complete (41 -> 42) (discovery-trial119). 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO state.py:1684 (2): Start update from 41 to 42 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_355d0258-04fb-4112-9ca1-344e8abfd619 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:49.988422] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.119:0/967364821, rc 0 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:49.988477] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.119:0/967364821 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.119:0/967364821' 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:49.998903] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_355d0258-04fb-4112-9ca1-344e8abfd619 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:49 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:49] INFO grpc.py:2517 (2): Received request to add bdev_355d0258-04fb-4112-9ca1-344e8abfd619 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:50.003287] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:50.003306] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:17:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO state.py:2068 (2): Update complete (41 -> 42) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:50.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO state.py:1684 (2): Start update from 41 to 42 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_355d0258-04fb-4112-9ca1-344e8abfd619 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO state.py:1684 (144): Start update from 41 to 42 (discovery-trial114). 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO state.py:2068 (144): Update complete (41 -> 42) (discovery-trial114). 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.982097] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.114:0/257109690, rc 0 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.982154] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.114:0/257109690 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.114:0/257109690' 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.991572] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_355d0258-04fb-4112-9ca1-344e8abfd619 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:49] INFO grpc.py:2517 (2): Received request to add bdev_355d0258-04fb-4112-9ca1-344e8abfd619 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.996148] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:17:50.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:49 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:49.996168] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:17:50.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO state.py:2068 (2): Update complete (41 -> 42) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:50.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO state.py:1684 (81): Start update from 41 to 42 (discovery-trial097). 2026-02-18T03:17:50.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:49 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:49] INFO state.py:2068 (81): Update complete (41 -> 42) (discovery-trial097). 2026-02-18T03:17:50.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:60760 2026-02-18T03:17:50.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage24, no need to remove 2026-02-18T03:17:50.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:50.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:60760 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.175101] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.97:0/2309407350, rc 0 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.175167] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.97:0/2309407350 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.97:0/2309407350' 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.184539] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO grpc.py:2517 (2): Received request to add bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: , client address: IPv4 10.20.193.31:60760 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.189093] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.189116] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_4, OMAP version: 43 2026-02-18T03:17:50.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.279283] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:50.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.279310] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:50.284 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:50.307 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:50.307 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:50.307 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage25 2026-02-18T03:17:50.307 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage25 --load-balancing-group 2 2026-02-18T03:17:50.346 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:50.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO state.py:1684 (2): Start update from 41 to 42 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:50.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:50.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_355d0258-04fb-4112-9ca1-344e8abfd619 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:50.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO state.py:1684 (123): Start update from 41 to 42 (discovery-trial194). 2026-02-18T03:17:50.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO state.py:2068 (123): Update complete (41 -> 42) (discovery-trial194). 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.983788] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.194:0/4091367094, rc 0 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.983849] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.194:0/4091367094 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.194:0/4091367094' 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.993525] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_355d0258-04fb-4112-9ca1-344e8abfd619 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:49] INFO grpc.py:2517 (2): Received request to add bdev_355d0258-04fb-4112-9ca1-344e8abfd619 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.997885] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:49.997907] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO state.py:2068 (2): Update complete (41 -> 42) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-mon[21799]: pgmap v107: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 6.3 KiB/s wr, 1.12k op/s 2026-02-18T03:17:50.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2215756488' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:50.706 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-mon[23907]: pgmap v107: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 6.3 KiB/s wr, 1.12k op/s 2026-02-18T03:17:50.707 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2215756488' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:50.709 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-mon[24143]: pgmap v107: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 6.3 KiB/s wr, 1.12k op/s 2026-02-18T03:17:50.709 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2215756488' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:50.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO state.py:1684 (99): Start update from 42 to 43 (discovery-trial119). 2026-02-18T03:17:50.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO state.py:2068 (99): Update complete (42 -> 43) (discovery-trial119). 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO state.py:1684 (2): Start update from 42 to 43 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:50.731234] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.119:0/1055049534, rc 0 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:50.731732] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.119:0/1055049534 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.119:0/1055049534' 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:50.740870] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO grpc.py:2517 (2): Received request to add bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:50.745537] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:17:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:50.745558] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:17:50.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] INFO state.py:2068 (2): Update complete (42 -> 43) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:50.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:50 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO state.py:1684 (2): Start update from 42 to 43 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO state.py:1684 (144): Start update from 42 to 43 (discovery-trial114). 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO state.py:2068 (144): Update complete (42 -> 43) (discovery-trial114). 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:50.727887] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.114:0/3059459009, rc 0 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:50.727954] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.114:0/3059459009 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.114:0/3059459009' 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:50.736725] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:50.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO grpc.py:2517 (2): Received request to add bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:17:50.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:50.741380] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:17:50.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:50.741403] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:17:50.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] INFO state.py:2068 (2): Update complete (42 -> 43) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:50.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:50 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:50] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:50.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO state.py:1684 (81): Start update from 42 to 43 (discovery-trial097). 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO state.py:2068 (81): Update complete (42 -> 43) (discovery-trial097). 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:53250 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage25, no need to remove 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_de301860-5580-44c5-b36c-685381fb6346 from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:53250 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.891424] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.97:0/3967605573, rc 0 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.891499] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.97:0/3967605573 2026-02-18T03:17:51.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.97:0/3967605573' 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.900928] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_de301860-5580-44c5-b36c-685381fb6346 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO grpc.py:2517 (2): Received request to add bdev_de301860-5580-44c5-b36c-685381fb6346 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: , client address: IPv4 10.20.193.31:53250 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.905628] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.905650] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_5, OMAP version: 44 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:50] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.998010] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:51.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:50 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:50.998037] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:51.002 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:51.023 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:51.024 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:51.024 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage26 2026-02-18T03:17:51.024 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage26 --load-balancing-group 3 2026-02-18T03:17:51.063 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:51Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:51.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO state.py:1684 (2): Start update from 42 to 43 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:51.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:51.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:51.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO state.py:1684 (123): Start update from 42 to 43 (discovery-trial194). 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO state.py:2068 (123): Update complete (42 -> 43) (discovery-trial194). 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:50.730049] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.194:0/1464952524, rc 0 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:50.730106] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.194:0/1464952524 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.194:0/1464952524' 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:50.740333] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO grpc.py:2517 (2): Received request to add bdev_7d1cd671-e842-4925-9ebf-e06cd3a897a5 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:50.744865] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:50.744883] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] INFO state.py:2068 (2): Update complete (42 -> 43) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:50 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO state.py:1684 (81): Start update from 43 to 44 (discovery-trial097). 2026-02-18T03:17:51.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO state.py:2068 (81): Update complete (43 -> 44) (discovery-trial097). 2026-02-18T03:17:51.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:54652 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage26, no need to remove 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:54652 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:51.578100] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.97:0/3544397886, rc 0 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:51.578169] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.97:0/3544397886 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.97:0/3544397886' 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:51.587264] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO grpc.py:2517 (2): Received request to add bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: , client address: IPv4 10.20.193.31:54652 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:51.591921] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:17:51.683 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:51.591944] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:17:51.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_6, OMAP version: 45 2026-02-18T03:17:51.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:51] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:51.680460] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:51.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:51 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:51.680490] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:51.684 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:51.708 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:51.708 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:51.708 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage27 2026-02-18T03:17:51.708 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage27 --load-balancing-group 4 2026-02-18T03:17:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] INFO state.py:1684 (99): Start update from 43 to 44 (discovery-trial119). 2026-02-18T03:17:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] INFO state.py:2068 (99): Update complete (43 -> 44) (discovery-trial119). 2026-02-18T03:17:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] INFO state.py:1684 (2): Start update from 43 to 44 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_de301860-5580-44c5-b36c-685381fb6346 from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:51.452661] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.119:0/1767878164, rc 0 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:51.452734] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.119:0/1767878164 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.119:0/1767878164' 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:51.462457] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_de301860-5580-44c5-b36c-685381fb6346 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] INFO grpc.py:2517 (2): Received request to add bdev_de301860-5580-44c5-b36c-685381fb6346 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:51.467023] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:51.467043] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] INFO state.py:2068 (2): Update complete (43 -> 44) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:51 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:51] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] INFO state.py:1684 (2): Start update from 43 to 44 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_de301860-5580-44c5-b36c-685381fb6346 from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] INFO state.py:1684 (144): Start update from 43 to 44 (discovery-trial114). 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] INFO state.py:2068 (144): Update complete (43 -> 44) (discovery-trial114). 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:51.458164] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.114:0/3878859267, rc 0 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:51.459243] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.114:0/3878859267 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.114:0/3878859267' 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:51.468376] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_de301860-5580-44c5-b36c-685381fb6346 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:51.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] INFO grpc.py:2517 (2): Received request to add bdev_de301860-5580-44c5-b36c-685381fb6346 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:17:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:51.472921] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:17:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:51.472944] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:17:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] INFO state.py:2068 (2): Update complete (43 -> 44) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:51 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:51] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.745 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:51Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:51.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] INFO state.py:1684 (123): Start update from 43 to 44 (discovery-trial194). 2026-02-18T03:17:51.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] INFO state.py:2068 (123): Update complete (43 -> 44) (discovery-trial194). 2026-02-18T03:17:51.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] INFO state.py:1684 (2): Start update from 43 to 44 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:51.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_de301860-5580-44c5-b36c-685381fb6346 from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:51.460785] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.194:0/1223048466, rc 0 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:51.460844] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.194:0/1223048466 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.194:0/1223048466' 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:51.469859] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_de301860-5580-44c5-b36c-685381fb6346 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] INFO grpc.py:2517 (2): Received request to add bdev_de301860-5580-44c5-b36c-685381fb6346 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:51.474495] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:51.474520] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] INFO state.py:2068 (2): Update complete (43 -> 44) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:51.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:51 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:52.357 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:52.379 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:52.379 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:52.379 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage28 2026-02-18T03:17:52.379 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage28 --load-balancing-group 1 2026-02-18T03:17:52.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO state.py:1684 (123): Start update from 44 to 45 (discovery-trial194). 2026-02-18T03:17:52.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO state.py:2068 (123): Update complete (44 -> 45) (discovery-trial194). 2026-02-18T03:17:52.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO state.py:1684 (2): Start update from 44 to 45 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:52.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:52.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:52.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.134683] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.194:0/1440513316, rc 0 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.135476] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.194:0/1440513316 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.194:0/1440513316' 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.152469] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO grpc.py:2517 (2): Received request to add bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.178678] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.178705] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO state.py:2068 (2): Update complete (44 -> 45) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:52.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:52.404 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-mon[21799]: pgmap v108: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 991 KiB/s rd, 5.1 KiB/s wr, 1.09k op/s 2026-02-18T03:17:52.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO state.py:1684 (81): Start update from 44 to 45 (discovery-trial097). 2026-02-18T03:17:52.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO state.py:2068 (81): Update complete (44 -> 45) (discovery-trial097). 2026-02-18T03:17:52.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:54250 2026-02-18T03:17:52.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage27, no need to remove 2026-02-18T03:17:52.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:54250 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.252597] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.97:0/4038442539, rc 0 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.252663] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.97:0/4038442539 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.97:0/4038442539' 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.261983] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO grpc.py:2517 (2): Received request to add bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: , client address: IPv4 10.20.193.31:54250 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.267046] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.267069] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_7, OMAP version: 46 2026-02-18T03:17:52.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:52.407 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:52.407 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.353091] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:52.407 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.353121] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:52.416 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:52Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:52.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-mon[24143]: pgmap v108: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 991 KiB/s rd, 5.1 KiB/s wr, 1.09k op/s 2026-02-18T03:17:52.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO state.py:1684 (2): Start update from 44 to 45 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:52.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:52.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO state.py:1684 (99): Start update from 44 to 45 (discovery-trial119). 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO state.py:2068 (99): Update complete (44 -> 45) (discovery-trial119). 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.130652] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.119:0/2216741014, rc 0 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.130713] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.119:0/2216741014 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.119:0/2216741014' 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.140499] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO grpc.py:2517 (2): Received request to add bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.145183] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.145203] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO state.py:2068 (2): Update complete (44 -> 45) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:52.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:52.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-mon[23907]: pgmap v108: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 991 KiB/s rd, 5.1 KiB/s wr, 1.09k op/s 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO state.py:1684 (2): Start update from 44 to 45 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO state.py:1684 (144): Start update from 44 to 45 (discovery-trial114). 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO state.py:2068 (144): Update complete (44 -> 45) (discovery-trial114). 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.128594] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.114:0/1359555685, rc 0 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.128654] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.114:0/1359555685 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.114:0/1359555685' 2026-02-18T03:17:52.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.137690] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO grpc.py:2517 (2): Received request to add bdev_799df629-ff37-4dd0-9fd3-1a4f25ef00a7 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:17:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.142535] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:17:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.142557] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:17:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO state.py:2068 (2): Update complete (44 -> 45) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:52.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.032 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:53.052 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:53.053 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:53.053 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage29 2026-02-18T03:17:53.053 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage29 --load-balancing-group 2 2026-02-18T03:17:53.083 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:53Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:53.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO state.py:1684 (2): Start update from 45 to 46 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:53.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO state.py:1684 (123): Start update from 45 to 46 (discovery-trial194). 2026-02-18T03:17:53.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:53.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO state.py:2068 (123): Update complete (45 -> 46) (discovery-trial194). 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.806848] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.194:0/605056735, rc 0 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.806903] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.194:0/605056735 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.194:0/605056735' 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.817465] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO grpc.py:2517 (2): Received request to add bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.822629] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:52.822652] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] INFO state.py:2068 (2): Update complete (45 -> 46) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:52 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO state.py:1684 (81): Start update from 45 to 46 (discovery-trial097). 2026-02-18T03:17:53.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO state.py:2068 (81): Update complete (45 -> 46) (discovery-trial097). 2026-02-18T03:17:53.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:48992 2026-02-18T03:17:53.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage28, no need to remove 2026-02-18T03:17:53.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:53.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d025fbc6-908e-4b28-985f-2b18488145a3 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:48992 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.917306] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.97:0/188547946, rc 0 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.917377] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.97:0/188547946 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.97:0/188547946' 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.926940] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d025fbc6-908e-4b28-985f-2b18488145a3 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO grpc.py:2517 (2): Received request to add bdev_d025fbc6-908e-4b28-985f-2b18488145a3 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: , client address: IPv4 10.20.193.31:48992 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.931387] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:52.931408] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_8, OMAP version: 47 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:52 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.027200] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:53.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.027225] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO state.py:1684 (99): Start update from 45 to 46 (discovery-trial119). 2026-02-18T03:17:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO state.py:2068 (99): Update complete (45 -> 46) (discovery-trial119). 2026-02-18T03:17:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO state.py:1684 (2): Start update from 45 to 46 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.808757] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.119:0/3031797704, rc 0 2026-02-18T03:17:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.808816] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.119:0/3031797704 2026-02-18T03:17:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.119:0/3031797704' 2026-02-18T03:17:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.819014] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO grpc.py:2517 (2): Received request to add bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:17:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.823983] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:17:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:52.824002] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:17:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] INFO state.py:2068 (2): Update complete (45 -> 46) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:52 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:52] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO state.py:1684 (2): Start update from 45 to 46 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO state.py:1684 (144): Start update from 45 to 46 (discovery-trial114). 2026-02-18T03:17:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO state.py:2068 (144): Update complete (45 -> 46) (discovery-trial114). 2026-02-18T03:17:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.806440] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.114:0/48565783, rc 0 2026-02-18T03:17:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.806519] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.114:0/48565783 2026-02-18T03:17:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.114:0/48565783' 2026-02-18T03:17:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.816010] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO grpc.py:2517 (2): Received request to add bdev_a7097e22-dfd3-4576-aff3-ec22d6c6d41b to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:17:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.820976] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:17:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:52.820999] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:17:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] INFO state.py:2068 (2): Update complete (45 -> 46) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:52 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] INFO state.py:1684 (2): Start update from 46 to 47 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d025fbc6-908e-4b28-985f-2b18488145a3 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] INFO state.py:1684 (99): Start update from 46 to 47 (discovery-trial119). 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] INFO state.py:2068 (99): Update complete (46 -> 47) (discovery-trial119). 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:53.471774] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.119:0/299213832, rc 0 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:53.471839] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.119:0/299213832 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.119:0/299213832' 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:53.482181] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d025fbc6-908e-4b28-985f-2b18488145a3 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] INFO grpc.py:2517 (2): Received request to add bdev_d025fbc6-908e-4b28-985f-2b18488145a3 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:17:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:53.486733] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:17:53.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:53.486752] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:17:53.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] INFO state.py:2068 (2): Update complete (46 -> 47) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:53.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:53 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] INFO state.py:1684 (144): Start update from 46 to 47 (discovery-trial114). 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] INFO state.py:2068 (144): Update complete (46 -> 47) (discovery-trial114). 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] INFO state.py:1684 (2): Start update from 46 to 47 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d025fbc6-908e-4b28-985f-2b18488145a3 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:53.472960] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.114:0/2508376415, rc 0 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:53.473234] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.114:0/2508376415 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.114:0/2508376415' 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:53.483817] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d025fbc6-908e-4b28-985f-2b18488145a3 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] INFO grpc.py:2517 (2): Received request to add bdev_d025fbc6-908e-4b28-985f-2b18488145a3 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:17:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:53.488357] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:17:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:53.488380] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:17:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] INFO state.py:2068 (2): Update complete (46 -> 47) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:53 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:53] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO state.py:1684 (81): Start update from 46 to 47 (discovery-trial097). 2026-02-18T03:17:53.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO state.py:2068 (81): Update complete (46 -> 47) (discovery-trial097). 2026-02-18T03:17:53.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:45804 2026-02-18T03:17:53.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage29, no need to remove 2026-02-18T03:17:53.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:53.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:53.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:45804 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.635241] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.97:0/1333659365, rc 0 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.635301] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.97:0/1333659365 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.97:0/1333659365' 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.644694] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO grpc.py:2517 (2): Received request to add bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: , client address: IPv4 10.20.193.31:45804 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.649176] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.649198] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_9, OMAP version: 48 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:53] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.749086] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:53.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:53 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:53.749120] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:53.754 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:53.777 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:53.777 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:53.777 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage30 2026-02-18T03:17:53.777 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage30 --load-balancing-group 3 2026-02-18T03:17:53.807 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:53Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:53.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] INFO state.py:1684 (123): Start update from 46 to 47 (discovery-trial194). 2026-02-18T03:17:53.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] INFO state.py:2068 (123): Update complete (46 -> 47) (discovery-trial194). 2026-02-18T03:17:53.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] INFO state.py:1684 (2): Start update from 46 to 47 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:53.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d025fbc6-908e-4b28-985f-2b18488145a3 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:53.470968] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.194:0/125521157, rc 0 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:53.471034] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.194:0/125521157 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.194:0/125521157' 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:53.481445] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d025fbc6-908e-4b28-985f-2b18488145a3 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] INFO grpc.py:2517 (2): Received request to add bdev_d025fbc6-908e-4b28-985f-2b18488145a3 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:53.485778] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:53.485801] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] INFO state.py:2068 (2): Update complete (46 -> 47) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:53.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:53 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:53] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:54.435 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-mon[21799]: pgmap v109: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 6.2 KiB/s wr, 1.14k op/s 2026-02-18T03:17:54.436 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO state.py:1684 (81): Start update from 47 to 48 (discovery-trial097). 2026-02-18T03:17:54.436 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO state.py:2068 (81): Update complete (47 -> 48) (discovery-trial097). 2026-02-18T03:17:54.436 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:34032 2026-02-18T03:17:54.436 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage30, no need to remove 2026-02-18T03:17:54.436 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:34032 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:54.333170] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.97:0/1187060744, rc 0 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:54.333238] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.97:0/1187060744 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.97:0/1187060744' 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:54.342930] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO grpc.py:2517 (2): Received request to add bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: , client address: IPv4 10.20.193.31:34032 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:54.347586] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:54.347607] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_10, OMAP version: 49 2026-02-18T03:17:54.437 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:54.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:54.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:54.433784] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:54.438 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:54.433809] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:54.438 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:54.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-mon[24143]: pgmap v109: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 6.2 KiB/s wr, 1.14k op/s 2026-02-18T03:17:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO state.py:1684 (99): Start update from 47 to 48 (discovery-trial119). 2026-02-18T03:17:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO state.py:2068 (99): Update complete (47 -> 48) (discovery-trial119). 2026-02-18T03:17:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO state.py:1684 (2): Start update from 47 to 48 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.190517] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.119:0/2091371482, rc 0 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.190574] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.119:0/2091371482 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.119:0/2091371482' 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.217219] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO grpc.py:2517 (2): Received request to add bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.221858] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.221879] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO state.py:2068 (2): Update complete (47 -> 48) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:54.466 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:54.466 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:54.466 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage31 2026-02-18T03:17:54.466 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage31 --load-balancing-group 4 2026-02-18T03:17:54.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-mon[23907]: pgmap v109: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 6.2 KiB/s wr, 1.14k op/s 2026-02-18T03:17:54.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO state.py:1684 (2): Start update from 47 to 48 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:54.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:54.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:54.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO state.py:1684 (144): Start update from 47 to 48 (discovery-trial114). 2026-02-18T03:17:54.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO state.py:2068 (144): Update complete (47 -> 48) (discovery-trial114). 2026-02-18T03:17:54.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.183957] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.114:0/1178076229, rc 0 2026-02-18T03:17:54.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.184019] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.114:0/1178076229 2026-02-18T03:17:54.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.114:0/1178076229' 2026-02-18T03:17:54.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.193774] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:54.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO grpc.py:2517 (2): Received request to add bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:17:54.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.198481] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:17:54.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.198503] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:17:54.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO state.py:2068 (2): Update complete (47 -> 48) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:54.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:54.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:54.502 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:54Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:54.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO state.py:1684 (2): Start update from 47 to 48 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:54.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:54.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO state.py:1684 (123): Start update from 47 to 48 (discovery-trial194). 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO state.py:2068 (123): Update complete (47 -> 48) (discovery-trial194). 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.190188] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.194:0/4121325305, rc 0 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.190473] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.194:0/4121325305 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.194:0/4121325305' 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.216882] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO grpc.py:2517 (2): Received request to add bdev_1e6a6f0a-795a-4d96-be44-4e3607d12eb5 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.221379] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.221402] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO state.py:2068 (2): Update complete (47 -> 48) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:54.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:54.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO state.py:1684 (2): Start update from 48 to 49 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:55.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:55.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO state.py:1684 (123): Start update from 48 to 49 (discovery-trial194). 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO state.py:2068 (123): Update complete (48 -> 49) (discovery-trial194). 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.885631] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.194:0/4225426927, rc 0 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.885701] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.194:0/4225426927 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.194:0/4225426927' 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.896185] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO grpc.py:2517 (2): Received request to add bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.900856] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:54.900879] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:54 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:54] INFO state.py:2068 (2): Update complete (48 -> 49) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO state.py:1684 (81): Start update from 48 to 49 (discovery-trial097). 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO state.py:2068 (81): Update complete (48 -> 49) (discovery-trial097). 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:39078 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage31, no need to remove 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:54 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:54] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_53b6c591-eb57-491b-886f-a4843f969538 from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:39078 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.039380] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.97:0/2556233941, rc 0 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.039445] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.97:0/2556233941 2026-02-18T03:17:55.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.97:0/2556233941' 2026-02-18T03:17:55.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.050393] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_53b6c591-eb57-491b-886f-a4843f969538 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:55.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO grpc.py:2517 (2): Received request to add bdev_53b6c591-eb57-491b-886f-a4843f969538 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: , client address: IPv4 10.20.193.31:39078 2026-02-18T03:17:55.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.073580] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:17:55.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.073609] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:17:55.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_11, OMAP version: 50 2026-02-18T03:17:55.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.169 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:55.191 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:55.191 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:55.192 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage32 2026-02-18T03:17:55.192 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage32 --load-balancing-group 1 2026-02-18T03:17:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO state.py:1684 (2): Start update from 48 to 49 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO state.py:1684 (99): Start update from 48 to 49 (discovery-trial119). 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO state.py:2068 (99): Update complete (48 -> 49) (discovery-trial119). 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.885365] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.119:0/3372782160, rc 0 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.885431] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.119:0/3372782160 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.119:0/3372782160' 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.896071] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO grpc.py:2517 (2): Received request to add bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.900639] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:54.900659] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:54 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:54] INFO state.py:2068 (2): Update complete (48 -> 49) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO state.py:1684 (144): Start update from 48 to 49 (discovery-trial114). 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO state.py:2068 (144): Update complete (48 -> 49) (discovery-trial114). 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO state.py:1684 (2): Start update from 48 to 49 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.890052] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.114:0/1006904459, rc 0 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.890117] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.114:0/1006904459 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.114:0/1006904459' 2026-02-18T03:17:55.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.901233] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:55.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO grpc.py:2517 (2): Received request to add bdev_7a5f77ce-ca97-4e42-bbe4-92888e24805a to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:17:55.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.922439] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:17:55.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:54.922469] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:17:55.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:54 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:54] INFO state.py:2068 (2): Update complete (48 -> 49) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:55.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.231 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:55Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:55.588 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1731825243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:55.589 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/513673352' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:55.591 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1731825243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:55.592 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/513673352' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:55.592 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1731825243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:55.592 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/513673352' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:55.593 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.165546] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:55.593 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.165571] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:55.593 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO state.py:1684 (81): Start update from 49 to 50 (discovery-trial097). 2026-02-18T03:17:55.593 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO state.py:2068 (81): Update complete (49 -> 50) (discovery-trial097). 2026-02-18T03:17:55.872 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:53432 2026-02-18T03:17:55.872 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage32, no need to remove 2026-02-18T03:17:55.872 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:55.872 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:55.872 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:53432 2026-02-18T03:17:55.872 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.757376] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.97:0/2220356840, rc 0 2026-02-18T03:17:55.872 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.757441] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.97:0/2220356840 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.97:0/2220356840' 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.767323] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO grpc.py:2517 (2): Received request to add bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: , client address: IPv4 10.20.193.31:53432 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.772422] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.772444] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_12, OMAP version: 51 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:55] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.869953] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:55.873 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:55 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:55.869980] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:55.874 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:55.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] INFO state.py:1684 (123): Start update from 49 to 50 (discovery-trial194). 2026-02-18T03:17:55.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] INFO state.py:2068 (123): Update complete (49 -> 50) (discovery-trial194). 2026-02-18T03:17:55.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] INFO state.py:1684 (2): Start update from 49 to 50 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:55.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:55.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_53b6c591-eb57-491b-886f-a4843f969538 from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:55.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:55.612987] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.194:0/690150215, rc 0 2026-02-18T03:17:55.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:55.613048] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.194:0/690150215 2026-02-18T03:17:55.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.194:0/690150215' 2026-02-18T03:17:55.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:55.622392] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_53b6c591-eb57-491b-886f-a4843f969538 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:55.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] INFO grpc.py:2517 (2): Received request to add bdev_53b6c591-eb57-491b-886f-a4843f969538 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:17:55.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:55.626993] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:17:55.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:55.627015] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:17:55.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] INFO state.py:2068 (2): Update complete (49 -> 50) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:55.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:55 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.894 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:55.894 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:55.894 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage33 2026-02-18T03:17:55.894 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage33 --load-balancing-group 2 2026-02-18T03:17:55.926 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:55Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:55.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] INFO state.py:1684 (2): Start update from 49 to 50 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:55.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:55.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_53b6c591-eb57-491b-886f-a4843f969538 from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] INFO state.py:1684 (99): Start update from 49 to 50 (discovery-trial119). 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] INFO state.py:2068 (99): Update complete (49 -> 50) (discovery-trial119). 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:55.616348] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.119:0/1692193068, rc 0 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:55.616424] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.119:0/1692193068 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.119:0/1692193068' 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:55.625902] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_53b6c591-eb57-491b-886f-a4843f969538 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] INFO grpc.py:2517 (2): Received request to add bdev_53b6c591-eb57-491b-886f-a4843f969538 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:55.630746] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:55.630770] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] INFO state.py:2068 (2): Update complete (49 -> 50) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:55 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:55] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] INFO state.py:1684 (144): Start update from 49 to 50 (discovery-trial114). 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] INFO state.py:2068 (144): Update complete (49 -> 50) (discovery-trial114). 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] INFO state.py:1684 (2): Start update from 49 to 50 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_53b6c591-eb57-491b-886f-a4843f969538 from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:55.618056] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.114:0/2393914776, rc 0 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:55.618118] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.114:0/2393914776 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.114:0/2393914776' 2026-02-18T03:17:55.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:55.627748] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_53b6c591-eb57-491b-886f-a4843f969538 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:55.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] INFO grpc.py:2517 (2): Received request to add bdev_53b6c591-eb57-491b-886f-a4843f969538 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:17:55.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:55.632600] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:17:55.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:55.632620] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:17:55.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] INFO state.py:2068 (2): Update complete (49 -> 50) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:55.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:55.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:55 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:55] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:56.541 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-mon[21799]: pgmap v110: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 5.2 KiB/s wr, 1.12k op/s 2026-02-18T03:17:56.541 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/975969904' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO state.py:1684 (81): Start update from 50 to 51 (discovery-trial097). 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO state.py:2068 (81): Update complete (50 -> 51) (discovery-trial097). 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:60348 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage33, no need to remove 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:60348 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:56.454535] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO grpc.py:2517 (2): Received request to add bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: , client address: IPv4 10.20.193.31:60348 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:56.458963] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:56.458984] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_13, OMAP version: 52 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:56.539774] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:56.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:56.539800] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:56.543 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:56.565 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:56.565 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:56.565 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage34 2026-02-18T03:17:56.565 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage34 --load-balancing-group 3 2026-02-18T03:17:56.609 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:56Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:56.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO state.py:1684 (123): Start update from 50 to 51 (discovery-trial194). 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO state.py:2068 (123): Update complete (50 -> 51) (discovery-trial194). 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO state.py:1684 (2): Start update from 50 to 51 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:56.311360] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.194:0/1180952677, rc 0 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:56.323474] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.194:0/1180952677 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.194:0/1180952677' 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:56.333259] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:56.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO grpc.py:2517 (2): Received request to add bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:17:56.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:56.338710] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:17:56.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:56.338735] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:17:56.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO state.py:2068 (2): Update complete (50 -> 51) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:56.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:56.633 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:56.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-mon[24143]: pgmap v110: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 5.2 KiB/s wr, 1.12k op/s 2026-02-18T03:17:56.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/975969904' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO state.py:1684 (2): Start update from 50 to 51 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO state.py:1684 (99): Start update from 50 to 51 (discovery-trial119). 2026-02-18T03:17:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO state.py:2068 (99): Update complete (50 -> 51) (discovery-trial119). 2026-02-18T03:17:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:56.312216] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.119:0/2340162329, rc 0 2026-02-18T03:17:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:56.312738] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.119:0/2340162329 2026-02-18T03:17:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.119:0/2340162329' 2026-02-18T03:17:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:56.322453] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO grpc.py:2517 (2): Received request to add bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:17:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:56.327451] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:17:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:56.327472] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:17:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO state.py:2068 (2): Update complete (50 -> 51) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:56.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-mon[23907]: pgmap v110: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 5.2 KiB/s wr, 1.12k op/s 2026-02-18T03:17:56.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/975969904' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:17:56.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO state.py:1684 (2): Start update from 50 to 51 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:56.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:56.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:56.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO state.py:1684 (144): Start update from 50 to 51 (discovery-trial114). 2026-02-18T03:17:56.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO state.py:2068 (144): Update complete (50 -> 51) (discovery-trial114). 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:56.311400] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.114:0/1165948089, rc 0 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:56.312236] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.114:0/1165948089 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.114:0/1165948089' 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:56.331229] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO grpc.py:2517 (2): Received request to add bdev_12ebc5c7-501e-4ba1-a386-bc4bb8cd68bf to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:56.342565] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:56.342589] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO state.py:2068 (2): Update complete (50 -> 51) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:56.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO state.py:1684 (81): Start update from 51 to 52 (discovery-trial097). 2026-02-18T03:17:57.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:56 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:56] INFO state.py:2068 (81): Update complete (51 -> 52) (discovery-trial097). 2026-02-18T03:17:57.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:33996 2026-02-18T03:17:57.242 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage34, no need to remove 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:33996 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.133128] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO grpc.py:2517 (2): Received request to add bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: , client address: IPv4 10.20.193.31:33996 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.137536] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.137559] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_14, OMAP version: 53 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.243 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.240333] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:57.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.240364] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:57.244 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:57.267 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:57.267 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:57.267 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage35 2026-02-18T03:17:57.268 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage35 --load-balancing-group 4 2026-02-18T03:17:57.299 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:57Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:57.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO state.py:1684 (2): Start update from 51 to 52 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:57.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO state.py:1684 (123): Start update from 51 to 52 (discovery-trial194). 2026-02-18T03:17:57.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO state.py:2068 (123): Update complete (51 -> 52) (discovery-trial194). 2026-02-18T03:17:57.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:57.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:56 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:57.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:57.000480] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:57.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO grpc.py:2517 (2): Received request to add bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:17:57.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:57.004873] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:17:57.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:57.004894] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:17:57.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO state.py:2068 (2): Update complete (51 -> 52) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:57.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO state.py:1684 (2): Start update from 51 to 52 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:57.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO state.py:1684 (99): Start update from 51 to 52 (discovery-trial119). 2026-02-18T03:17:57.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO state.py:2068 (99): Update complete (51 -> 52) (discovery-trial119). 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:56 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:56.999781] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO grpc.py:2517 (2): Received request to add bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:57.004204] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:57.004225] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO state.py:2068 (2): Update complete (51 -> 52) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO state.py:1684 (2): Start update from 51 to 52 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:57.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:57.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:57.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO state.py:1684 (144): Start update from 51 to 52 (discovery-trial114). 2026-02-18T03:17:57.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO state.py:2068 (144): Update complete (51 -> 52) (discovery-trial114). 2026-02-18T03:17:57.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:56.996298] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:57.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:56 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:56] INFO grpc.py:2517 (2): Received request to add bdev_9ec31b48-daa3-43b4-85d8-24d81faad9a1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:17:57.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:57.000693] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:17:57.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:57.000721] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:17:57.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] INFO state.py:2068 (2): Update complete (51 -> 52) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:57.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO state.py:1684 (81): Start update from 52 to 53 (discovery-trial097). 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO state.py:2068 (81): Update complete (52 -> 53) (discovery-trial097). 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:33584 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage35, no need to remove 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:33584 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.830518] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO grpc.py:2517 (2): Received request to add bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: , client address: IPv4 10.20.193.31:33584 2026-02-18T03:17:57.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.835095] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:17:57.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.835122] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:17:57.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_15, OMAP version: 54 2026-02-18T03:17:57.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.924644] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:57.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:57.924676] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:57.929 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:57.949 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:57.949 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:57.949 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage36 2026-02-18T03:17:57.950 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage36 --load-balancing-group 1 2026-02-18T03:17:57.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO state.py:1684 (99): Start update from 52 to 53 (discovery-trial119). 2026-02-18T03:17:57.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO state.py:1684 (2): Start update from 52 to 53 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:57.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO state.py:2068 (99): Update complete (52 -> 53) (discovery-trial119). 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:57.677147] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO grpc.py:2517 (2): Received request to add bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:57.681537] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:57.681560] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] INFO state.py:2068 (2): Update complete (52 -> 53) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:57 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] INFO state.py:1684 (2): Start update from 52 to 53 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:57.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:57.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:57.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] INFO state.py:1684 (144): Start update from 52 to 53 (discovery-trial114). 2026-02-18T03:17:57.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] INFO state.py:2068 (144): Update complete (52 -> 53) (discovery-trial114). 2026-02-18T03:17:57.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:57.674243] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:57.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] INFO grpc.py:2517 (2): Received request to add bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:17:57.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:57.678627] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:17:57.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:57.678650] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:17:57.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] INFO state.py:2068 (2): Update complete (52 -> 53) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:57.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:57 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:57.978 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:57Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:58.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO state.py:1684 (123): Start update from 52 to 53 (discovery-trial194). 2026-02-18T03:17:58.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO state.py:2068 (123): Update complete (52 -> 53) (discovery-trial194). 2026-02-18T03:17:58.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO state.py:1684 (2): Start update from 52 to 53 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:58.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:58.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:58.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:57.678611] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:58.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO grpc.py:2517 (2): Received request to add bdev_f27c6c4d-1c7f-401d-8ee2-2f3acc94ba12 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:17:58.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:57.683024] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:17:58.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:57.683045] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:17:58.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] INFO state.py:2068 (2): Update complete (52 -> 53) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:58.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:57 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.588 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-mon[21799]: pgmap v111: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.5 KiB/s wr, 1.23k op/s 2026-02-18T03:17:58.588 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:17:58.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO state.py:1684 (81): Start update from 53 to 54 (discovery-trial097). 2026-02-18T03:17:58.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO state.py:2068 (81): Update complete (53 -> 54) (discovery-trial097). 2026-02-18T03:17:58.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:49144 2026-02-18T03:17:58.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage36, no need to remove 2026-02-18T03:17:58.589 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:58.589 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:58.589 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:49144 2026-02-18T03:17:58.589 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:58.586271] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:58.600 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-mon[24143]: pgmap v111: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.5 KiB/s wr, 1.23k op/s 2026-02-18T03:17:58.601 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:17:58.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] INFO state.py:1684 (99): Start update from 53 to 54 (discovery-trial119). 2026-02-18T03:17:58.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] INFO state.py:2068 (99): Update complete (53 -> 54) (discovery-trial119). 2026-02-18T03:17:58.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] INFO state.py:1684 (2): Start update from 53 to 54 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:58.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:58.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:58.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:58.383736] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:58.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] INFO grpc.py:2517 (2): Received request to add bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:17:58.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:58.391966] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:17:58.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:58.391991] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:17:58.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] INFO state.py:2068 (2): Update complete (53 -> 54) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:58.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.602 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-mon[23907]: pgmap v111: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.5 KiB/s wr, 1.23k op/s 2026-02-18T03:17:58.602 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] INFO state.py:1684 (144): Start update from 53 to 54 (discovery-trial114). 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] INFO state.py:2068 (144): Update complete (53 -> 54) (discovery-trial114). 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] INFO state.py:1684 (2): Start update from 53 to 54 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:58.379624] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] INFO grpc.py:2517 (2): Received request to add bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:58.384415] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:17:58.603 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:58.384446] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:17:58.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] INFO state.py:2068 (2): Update complete (53 -> 54) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:58.604 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.604 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] INFO state.py:1684 (123): Start update from 53 to 54 (discovery-trial194). 2026-02-18T03:17:58.604 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] INFO state.py:2068 (123): Update complete (53 -> 54) (discovery-trial194). 2026-02-18T03:17:58.604 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] INFO state.py:1684 (2): Start update from 53 to 54 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:58.604 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:58.604 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:58.605 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:58.380480] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:58.605 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] INFO grpc.py:2517 (2): Received request to add bdev_f084cebc-f679-4a5a-a739-f93ee6a53085 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:17:58.605 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:58.388709] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:17:58.605 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:58.388734] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:17:58.605 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] INFO state.py:2068 (2): Update complete (53 -> 54) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:58.605 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.605 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:58 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:58] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.690 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:58.711 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:58.711 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:58.711 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage37 2026-02-18T03:17:58.711 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage37 --load-balancing-group 2 2026-02-18T03:17:58.749 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:58.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO grpc.py:2517 (2): Received request to add bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: , client address: IPv4 10.20.193.31:49144 2026-02-18T03:17:58.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:58.590738] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:17:58.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:58.590767] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:17:58.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_16, OMAP version: 55 2026-02-18T03:17:58.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:58] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:58.686201] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:58.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:58 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:58.686233] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:58 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:58] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:58.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:58 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:59.366 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:17:59.366 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:17:59.366 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:17:59.366 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:17:59.367 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO state.py:1684 (81): Start update from 54 to 55 (discovery-trial097). 2026-02-18T03:17:59.367 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO state.py:2068 (81): Update complete (54 -> 55) (discovery-trial097). 2026-02-18T03:17:59.367 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:56114 2026-02-18T03:17:59.367 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage37, no need to remove 2026-02-18T03:17:59.367 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:17:59.367 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:17:59.367 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:56114 2026-02-18T03:17:59.367 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:59.266607] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:59.368 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO grpc.py:2517 (2): Received request to add bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: , client address: IPv4 10.20.193.31:56114 2026-02-18T03:17:59.368 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:59.271030] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:17:59.368 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:59.271058] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:17:59.368 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_17, OMAP version: 56 2026-02-18T03:17:59.368 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:59.368 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:59.368 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:59.364723] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:17:59.368 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:59.364757] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:17:59.369 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:17:59.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO state.py:1684 (2): Start update from 54 to 55 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:59.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:59.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:59.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO state.py:1684 (123): Start update from 54 to 55 (discovery-trial194). 2026-02-18T03:17:59.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO state.py:2068 (123): Update complete (54 -> 55) (discovery-trial194). 2026-02-18T03:17:59.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:59.130206] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:59.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO grpc.py:2517 (2): Received request to add bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:17:59.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:59.134668] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:17:59.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:59.134688] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:17:59.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO state.py:2068 (2): Update complete (54 -> 55) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:17:59.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:59.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:59.390 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:17:59.390 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:17:59.390 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage38 2026-02-18T03:17:59.390 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage38 --load-balancing-group 3 2026-02-18T03:17:59.433 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:17:59Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:17:59.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:17:59.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:17:59.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:17:59.463 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO state.py:1684 (2): Start update from 54 to 55 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO state.py:1684 (99): Start update from 54 to 55 (discovery-trial119). 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO state.py:2068 (99): Update complete (54 -> 55) (discovery-trial119). 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:59.133508] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO grpc.py:2517 (2): Received request to add bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:59.137947] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:59.137969] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO state.py:2068 (2): Update complete (54 -> 55) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:17:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:59.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:59.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:17:59.473 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:17:59.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:17:59.474 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:17:59.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO state.py:1684 (144): Start update from 54 to 55 (discovery-trial114). 2026-02-18T03:17:59.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO state.py:2068 (144): Update complete (54 -> 55) (discovery-trial114). 2026-02-18T03:17:59.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO state.py:1684 (2): Start update from 54 to 55 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:59.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:17:59.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:17:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:59.134387] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:17:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO grpc.py:2517 (2): Received request to add bdev_c68a5f2a-5b7d-458b-9b1b-8dbdecb0761a to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:17:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:59.138847] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:17:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:59.138873] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:17:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO state.py:2068 (2): Update complete (54 -> 55) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:17:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:17:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.046 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO state.py:1684 (81): Start update from 55 to 56 (discovery-trial097). 2026-02-18T03:18:00.047 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO state.py:2068 (81): Update complete (55 -> 56) (discovery-trial097). 2026-02-18T03:18:00.047 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:47820 2026-02-18T03:18:00.047 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage38, no need to remove 2026-02-18T03:18:00.047 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:00.047 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:00.047 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:47820 2026-02-18T03:18:00.047 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:59.941506] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:00.047 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO grpc.py:2517 (2): Received request to add bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: , client address: IPv4 10.20.193.31:47820 2026-02-18T03:18:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:59.945935] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:18:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:17:59.945957] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:18:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_18, OMAP version: 57 2026-02-18T03:18:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:17:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:17:59] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:00.044939] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:00.044965] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:00.049 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:18:00.071 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:00.071 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:00.071 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage39 2026-02-18T03:18:00.071 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage39 --load-balancing-group 4 2026-02-18T03:18:00.104 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO state.py:1684 (123): Start update from 55 to 56 (discovery-trial194). 2026-02-18T03:18:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO state.py:2068 (123): Update complete (55 -> 56) (discovery-trial194). 2026-02-18T03:18:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO state.py:1684 (2): Start update from 55 to 56 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:59.816478] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO grpc.py:2517 (2): Received request to add bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:18:00.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:59.836713] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:18:00.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:17:59.836740] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:18:00.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] INFO state.py:2068 (2): Update complete (55 -> 56) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:00.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:17:59 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:17:59] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO state.py:1684 (2): Start update from 55 to 56 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO state.py:1684 (99): Start update from 55 to 56 (discovery-trial119). 2026-02-18T03:18:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO state.py:2068 (99): Update complete (55 -> 56) (discovery-trial119). 2026-02-18T03:18:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:59.824736] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO grpc.py:2517 (2): Received request to add bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:18:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:59.835974] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:18:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:17:59.835999] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:18:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] INFO state.py:2068 (2): Update complete (55 -> 56) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:17:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:17:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO state.py:1684 (2): Start update from 55 to 56 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO state.py:1684 (144): Start update from 55 to 56 (discovery-trial114). 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO state.py:2068 (144): Update complete (55 -> 56) (discovery-trial114). 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:59.811252] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO grpc.py:2517 (2): Received request to add bdev_0aff1c0b-f35a-4bf1-a510-e137c7f6bad8 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:59.815744] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:18:00.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:17:59.815770] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:18:00.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] INFO state.py:2068 (2): Update complete (55 -> 56) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:00.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:17:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:17:59] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-mon[24143]: pgmap v112: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 6.5 KiB/s wr, 1.18k op/s 2026-02-18T03:18:00.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] INFO state.py:1684 (99): Start update from 56 to 57 (discovery-trial119). 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] INFO state.py:2068 (99): Update complete (56 -> 57) (discovery-trial119). 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] INFO state.py:1684 (2): Start update from 56 to 57 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:00.499735] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] INFO grpc.py:2517 (2): Received request to add bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:00.504153] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:00.504173] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] INFO state.py:2068 (2): Update complete (56 -> 57) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:00.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-mon[23907]: pgmap v112: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 6.5 KiB/s wr, 1.18k op/s 2026-02-18T03:18:00.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] INFO state.py:1684 (2): Start update from 56 to 57 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:00.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:00.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:00.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] INFO state.py:1684 (144): Start update from 56 to 57 (discovery-trial114). 2026-02-18T03:18:00.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] INFO state.py:2068 (144): Update complete (56 -> 57) (discovery-trial114). 2026-02-18T03:18:00.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:00.489370] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:00.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] INFO grpc.py:2517 (2): Received request to add bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:18:00.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:00.493807] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:18:00.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:00.493834] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:18:00.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] INFO state.py:2068 (2): Update complete (56 -> 57) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:00.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:00] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.747 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-mon[21799]: pgmap v112: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 6.5 KiB/s wr, 1.18k op/s 2026-02-18T03:18:00.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO state.py:1684 (81): Start update from 56 to 57 (discovery-trial097). 2026-02-18T03:18:00.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO state.py:2068 (81): Update complete (56 -> 57) (discovery-trial097). 2026-02-18T03:18:00.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:47378 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage39, no need to remove 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:47378 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:00.653849] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO grpc.py:2517 (2): Received request to add bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: , client address: IPv4 10.20.193.31:47378 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:00.658232] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:00.658261] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_19, OMAP version: 58 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:00] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:00.745672] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:00.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:00.745707] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:00.750 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:18:00.772 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:00.772 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:00.772 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage40 2026-02-18T03:18:00.772 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage40 --load-balancing-group 1 2026-02-18T03:18:00.818 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] INFO state.py:1684 (2): Start update from 56 to 57 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] INFO state.py:1684 (123): Start update from 56 to 57 (discovery-trial194). 2026-02-18T03:18:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] INFO state.py:2068 (123): Update complete (56 -> 57) (discovery-trial194). 2026-02-18T03:18:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:00.485401] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] INFO grpc.py:2517 (2): Received request to add bdev_3b10ac78-6101-4c22-a905-b345f5ec8e33 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:18:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:00.489787] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:18:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:00.489809] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:18:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] INFO state.py:2068 (2): Update complete (56 -> 57) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:00.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:00] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:01.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO state.py:1684 (81): Start update from 57 to 58 (discovery-trial097). 2026-02-18T03:18:01.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO state.py:2068 (81): Update complete (57 -> 58) (discovery-trial097). 2026-02-18T03:18:01.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:33798 2026-02-18T03:18:01.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage40, no need to remove 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:33798 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:01.351305] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO grpc.py:2517 (2): Received request to add bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: , client address: IPv4 10.20.193.31:33798 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:01.355764] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:01.355790] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_20, OMAP version: 59 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:01.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:01.448433] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:01.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:01.448461] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:01.453 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:18:01.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO state.py:1684 (99): Start update from 57 to 58 (discovery-trial119). 2026-02-18T03:18:01.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO state.py:2068 (99): Update complete (57 -> 58) (discovery-trial119). 2026-02-18T03:18:01.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO state.py:1684 (2): Start update from 57 to 58 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:01.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:01.200130] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO grpc.py:2517 (2): Received request to add bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:18:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:01.204502] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:18:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:01.204522] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:18:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO state.py:2068 (2): Update complete (57 -> 58) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:01.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO state.py:1684 (2): Start update from 57 to 58 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:01.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:01.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:01.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO state.py:1684 (144): Start update from 57 to 58 (discovery-trial114). 2026-02-18T03:18:01.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO state.py:2068 (144): Update complete (57 -> 58) (discovery-trial114). 2026-02-18T03:18:01.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:01.203226] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:01.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO grpc.py:2517 (2): Received request to add bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:18:01.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:01.220406] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:18:01.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:01.220433] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:18:01.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO state.py:2068 (2): Update complete (57 -> 58) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:01.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:01.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:01.476 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:01.476 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:18:01.476 INFO:tasks.workunit.client.0.trial031.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:01.476 INFO:tasks.workunit.client.0.trial031.stderr:++ seq 1 20 2026-02-18T03:18:01.476 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:01.476 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage41 2026-02-18T03:18:01.477 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage41 --load-balancing-group 2 2026-02-18T03:18:01.517 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:01Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:01.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO state.py:1684 (2): Start update from 57 to 58 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:01.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:01.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:01.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO state.py:1684 (123): Start update from 57 to 58 (discovery-trial194). 2026-02-18T03:18:01.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO state.py:2068 (123): Update complete (57 -> 58) (discovery-trial194). 2026-02-18T03:18:01.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:01.194169] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:01.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO grpc.py:2517 (2): Received request to add bdev_b6a5bc69-a278-41f1-bf4e-8ff43a57ad49 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:18:01.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:01.199064] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:18:01.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:01.199085] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:18:01.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO state.py:2068 (2): Update complete (57 -> 58) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:01.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:01.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO state.py:1684 (2): Start update from 58 to 59 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:02.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:02.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:02.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO state.py:1684 (123): Start update from 58 to 59 (discovery-trial194). 2026-02-18T03:18:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO state.py:2068 (123): Update complete (58 -> 59) (discovery-trial194). 2026-02-18T03:18:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:01.895730] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO grpc.py:2517 (2): Received request to add bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:18:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:01.900122] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:18:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:01.900144] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:18:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:01 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:01] INFO state.py:2068 (2): Update complete (58 -> 59) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO state.py:1684 (81): Start update from 58 to 59 (discovery-trial097). 2026-02-18T03:18:02.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO state.py:2068 (81): Update complete (58 -> 59) (discovery-trial097). 2026-02-18T03:18:02.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:44908 2026-02-18T03:18:02.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage41, no need to remove 2026-02-18T03:18:02.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:02.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:01] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:02.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f075f394-603a-4a95-b982-296fcaee4d7a from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:44908 2026-02-18T03:18:02.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.057872] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f075f394-603a-4a95-b982-296fcaee4d7a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:02.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO grpc.py:2517 (2): Received request to add bdev_f075f394-603a-4a95-b982-296fcaee4d7a to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: , client address: IPv4 10.20.193.31:44908 2026-02-18T03:18:02.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.062338] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:18:02.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.062372] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:18:02.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_1, OMAP version: 60 2026-02-18T03:18:02.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.159 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:02.179 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:02.179 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:02.179 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage42 2026-02-18T03:18:02.179 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage42 --load-balancing-group 3 2026-02-18T03:18:02.201 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:02Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO state.py:1684 (99): Start update from 58 to 59 (discovery-trial119). 2026-02-18T03:18:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO state.py:2068 (99): Update complete (58 -> 59) (discovery-trial119). 2026-02-18T03:18:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO state.py:1684 (2): Start update from 58 to 59 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:01.898547] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO grpc.py:2517 (2): Received request to add bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:18:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:01.902973] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:18:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:01.902995] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:18:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:01 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:01] INFO state.py:2068 (2): Update complete (58 -> 59) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO state.py:1684 (2): Start update from 58 to 59 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO state.py:1684 (144): Start update from 58 to 59 (discovery-trial114). 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO state.py:2068 (144): Update complete (58 -> 59) (discovery-trial114). 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:01.896337] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO grpc.py:2517 (2): Received request to add bdev_936c0c62-ede6-4f59-a059-2d59e1f418ff to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:01.900759] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:18:02.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:01.900784] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:18:02.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:01 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:01] INFO state.py:2068 (2): Update complete (58 -> 59) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:02.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.154523] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:02.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.154554] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:02.500 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-mon[23907]: pgmap v113: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 985 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2026-02-18T03:18:02.500 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1079217165' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:02.500 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2124753870' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:02.732 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-mon[21799]: pgmap v113: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 985 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2026-02-18T03:18:02.733 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1079217165' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:02.733 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2124753870' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO state.py:1684 (81): Start update from 59 to 60 (discovery-trial097). 2026-02-18T03:18:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO state.py:2068 (81): Update complete (59 -> 60) (discovery-trial097). 2026-02-18T03:18:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:46254 2026-02-18T03:18:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage42, no need to remove 2026-02-18T03:18:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:46254 2026-02-18T03:18:02.769 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] INFO state.py:1684 (144): Start update from 59 to 60 (discovery-trial114). 2026-02-18T03:18:02.769 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] INFO state.py:2068 (144): Update complete (59 -> 60) (discovery-trial114). 2026-02-18T03:18:02.769 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] INFO state.py:1684 (2): Start update from 59 to 60 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:02.769 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:02.769 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f075f394-603a-4a95-b982-296fcaee4d7a from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:02.769 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:02.613626] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f075f394-603a-4a95-b982-296fcaee4d7a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:02.770 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] INFO grpc.py:2517 (2): Received request to add bdev_f075f394-603a-4a95-b982-296fcaee4d7a to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:18:02.770 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:02.634468] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:18:02.770 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:02.634499] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:18:02.770 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] INFO state.py:2068 (2): Update complete (59 -> 60) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:02.770 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.770 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-mon[24143]: pgmap v113: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 985 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2026-02-18T03:18:02.771 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1079217165' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:02.771 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2124753870' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:02.771 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] INFO state.py:1684 (99): Start update from 59 to 60 (discovery-trial119). 2026-02-18T03:18:02.771 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] INFO state.py:2068 (99): Update complete (59 -> 60) (discovery-trial119). 2026-02-18T03:18:02.771 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] INFO state.py:1684 (2): Start update from 59 to 60 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:02.771 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:02.771 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f075f394-603a-4a95-b982-296fcaee4d7a from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:02.771 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:02.603669] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f075f394-603a-4a95-b982-296fcaee4d7a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:02.772 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] INFO grpc.py:2517 (2): Received request to add bdev_f075f394-603a-4a95-b982-296fcaee4d7a to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:18:02.772 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:02.608263] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:18:02.772 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:02.608284] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:18:02.772 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] INFO state.py:2068 (2): Update complete (59 -> 60) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:02.772 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.863 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:02.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] INFO state.py:1684 (2): Start update from 59 to 60 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:02.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:02.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f075f394-603a-4a95-b982-296fcaee4d7a from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:02.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] INFO state.py:1684 (123): Start update from 59 to 60 (discovery-trial194). 2026-02-18T03:18:02.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] INFO state.py:2068 (123): Update complete (59 -> 60) (discovery-trial194). 2026-02-18T03:18:02.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:02.601415] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f075f394-603a-4a95-b982-296fcaee4d7a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:02.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] INFO grpc.py:2517 (2): Received request to add bdev_f075f394-603a-4a95-b982-296fcaee4d7a to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:18:02.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:02.605984] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:18:02.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:02.606007] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:18:02.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] INFO state.py:2068 (2): Update complete (59 -> 60) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:02.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:02 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:02] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:02.885 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:02.885 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:02.885 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage43 2026-02-18T03:18:02.885 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage43 --load-balancing-group 4 2026-02-18T03:18:02.927 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:02Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:03.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.755241] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:03.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO grpc.py:2517 (2): Received request to add bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: , client address: IPv4 10.20.193.31:46254 2026-02-18T03:18:03.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.759709] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:18:03.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.759737] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:18:03.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_2, OMAP version: 61 2026-02-18T03:18:03.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:02] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.858745] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:03.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:02 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:02.858774] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:02 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:02 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:02] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.574 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2340567716' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO state.py:1684 (81): Start update from 60 to 61 (discovery-trial097). 2026-02-18T03:18:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO state.py:2068 (81): Update complete (60 -> 61) (discovery-trial097). 2026-02-18T03:18:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:43924 2026-02-18T03:18:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage43, no need to remove 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:43924 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:03.468117] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO grpc.py:2517 (2): Received request to add bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: , client address: IPv4 10.20.193.31:43924 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:03.472671] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:03.472699] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_3, OMAP version: 62 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.576 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:03.572086] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:03.576 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:03.572117] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:03.576 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:03.597 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:03.597 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:03.597 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage44 2026-02-18T03:18:03.597 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage44 --load-balancing-group 1 2026-02-18T03:18:03.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO state.py:1684 (2): Start update from 60 to 61 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:03.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:03.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:03.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO state.py:1684 (123): Start update from 60 to 61 (discovery-trial194). 2026-02-18T03:18:03.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO state.py:2068 (123): Update complete (60 -> 61) (discovery-trial194). 2026-02-18T03:18:03.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:03.295551] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:03.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO grpc.py:2517 (2): Received request to add bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:18:03.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:03.299982] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:18:03.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:03.300002] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:18:03.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO state.py:2068 (2): Update complete (60 -> 61) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:03.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.636 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:03Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:03.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2340567716' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:03.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO state.py:1684 (99): Start update from 60 to 61 (discovery-trial119). 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO state.py:2068 (99): Update complete (60 -> 61) (discovery-trial119). 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO state.py:1684 (2): Start update from 60 to 61 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:03.304371] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO grpc.py:2517 (2): Received request to add bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:03.308752] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:03.308777] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO state.py:2068 (2): Update complete (60 -> 61) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2340567716' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:03.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO state.py:1684 (2): Start update from 60 to 61 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:03.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:03.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:03.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO state.py:1684 (144): Start update from 60 to 61 (discovery-trial114). 2026-02-18T03:18:03.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO state.py:2068 (144): Update complete (60 -> 61) (discovery-trial114). 2026-02-18T03:18:03.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:03.298850] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:03.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO grpc.py:2517 (2): Received request to add bdev_d0959194-3a34-43bc-bef9-4745ba17ce58 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:18:03.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:03.303407] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:18:03.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:03.303432] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:18:03.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO state.py:2068 (2): Update complete (60 -> 61) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:03.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:03.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.302 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO state.py:1684 (81): Start update from 61 to 62 (discovery-trial097). 2026-02-18T03:18:04.302 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:03 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:03] INFO state.py:2068 (81): Update complete (61 -> 62) (discovery-trial097). 2026-02-18T03:18:04.302 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:52752 2026-02-18T03:18:04.303 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage44, no need to remove 2026-02-18T03:18:04.303 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:04.303 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:04.303 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:52752 2026-02-18T03:18:04.303 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:04.186400] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:04.303 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO grpc.py:2517 (2): Received request to add bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: , client address: IPv4 10.20.193.31:52752 2026-02-18T03:18:04.303 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:04.194595] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:18:04.303 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:04.194622] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:18:04.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_4, OMAP version: 63 2026-02-18T03:18:04.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.305 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:04.327 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:04.327 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:04.327 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage45 2026-02-18T03:18:04.327 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage45 --load-balancing-group 2 2026-02-18T03:18:04.359 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO state.py:1684 (2): Start update from 61 to 62 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO state.py:1684 (123): Start update from 61 to 62 (discovery-trial194). 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:03 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:03] INFO state.py:2068 (123): Update complete (61 -> 62) (discovery-trial194). 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:04.012438] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO grpc.py:2517 (2): Received request to add bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:04.016821] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:04.016844] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:18:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO state.py:2068 (2): Update complete (61 -> 62) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:04.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.373 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:04Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:04.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO state.py:1684 (99): Start update from 61 to 62 (discovery-trial119). 2026-02-18T03:18:04.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO state.py:2068 (99): Update complete (61 -> 62) (discovery-trial119). 2026-02-18T03:18:04.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO state.py:1684 (2): Start update from 61 to 62 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:03 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:04.016762] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO grpc.py:2517 (2): Received request to add bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:04.021152] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:04.021171] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO state.py:2068 (2): Update complete (61 -> 62) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO state.py:1684 (2): Start update from 61 to 62 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO state.py:1684 (144): Start update from 61 to 62 (discovery-trial114). 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:03 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:03] INFO state.py:2068 (144): Update complete (61 -> 62) (discovery-trial114). 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:04.012254] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO grpc.py:2517 (2): Received request to add bdev_5511460c-e585-4a7c-a1af-1c535f9ec4ce to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:04.017107] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:18:04.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:04.017132] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:18:04.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO state.py:2068 (2): Update complete (61 -> 62) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:04.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:04.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-mon[21799]: pgmap v114: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 6.4 KiB/s wr, 1.22k op/s 2026-02-18T03:18:04.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2802715356' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:04.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:04.300613] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:04.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:04.300643] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:04.742 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-mon[23907]: pgmap v114: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 6.4 KiB/s wr, 1.22k op/s 2026-02-18T03:18:04.742 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2802715356' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:04.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO state.py:1684 (144): Start update from 62 to 63 (discovery-trial114). 2026-02-18T03:18:04.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO state.py:2068 (144): Update complete (62 -> 63) (discovery-trial114). 2026-02-18T03:18:04.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO state.py:1684 (2): Start update from 62 to 63 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:04.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:04.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:04.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:04.741465] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:04.746 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-mon[24143]: pgmap v114: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 6.4 KiB/s wr, 1.22k op/s 2026-02-18T03:18:04.746 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2802715356' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:04.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO state.py:1684 (99): Start update from 62 to 63 (discovery-trial119). 2026-02-18T03:18:04.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO state.py:2068 (99): Update complete (62 -> 63) (discovery-trial119). 2026-02-18T03:18:04.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO state.py:1684 (2): Start update from 62 to 63 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:04.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:04.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:04.747 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:04.745296] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:05.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO state.py:1684 (81): Start update from 62 to 63 (discovery-trial097). 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO state.py:2068 (81): Update complete (62 -> 63) (discovery-trial097). 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:39606 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage45, no need to remove 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:39606 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:04.921252] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO grpc.py:2517 (2): Received request to add bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: , client address: IPv4 10.20.193.31:39606 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:04.925700] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:18:05.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:04.925727] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:18:05.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_5, OMAP version: 64 2026-02-18T03:18:05.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:04 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:04] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:05.024761] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:05.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:05.024791] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:05.029 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:05.050 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:05.050 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:05.050 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage46 2026-02-18T03:18:05.050 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage46 --load-balancing-group 3 2026-02-18T03:18:05.088 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:05.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO state.py:1684 (2): Start update from 62 to 63 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:05.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:05.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:05.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO state.py:1684 (123): Start update from 62 to 63 (discovery-trial194). 2026-02-18T03:18:05.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO state.py:2068 (123): Update complete (62 -> 63) (discovery-trial194). 2026-02-18T03:18:05.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:04.746322] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:05.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO grpc.py:2517 (2): Received request to add bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:18:05.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:04.750752] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:18:05.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:04.750773] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:18:05.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] INFO state.py:2068 (2): Update complete (62 -> 63) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:05.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:04 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:04] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO grpc.py:2517 (2): Received request to add bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:18:05.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:04.749724] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:18:05.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:04.749746] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:18:05.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] INFO state.py:2068 (2): Update complete (62 -> 63) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:05.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:04 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO grpc.py:2517 (2): Received request to add bdev_a2b5400c-6d44-4ce1-bf69-a5253bb619cd to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:18:05.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:04.746095] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:18:05.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:04.746117] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:18:05.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] INFO state.py:2068 (2): Update complete (62 -> 63) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:05.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:04 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:04] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO state.py:1684 (81): Start update from 63 to 64 (discovery-trial097). 2026-02-18T03:18:05.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO state.py:2068 (81): Update complete (63 -> 64) (discovery-trial097). 2026-02-18T03:18:05.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:51144 2026-02-18T03:18:05.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage46, no need to remove 2026-02-18T03:18:05.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:51144 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:05.613962] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO grpc.py:2517 (2): Received request to add bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: , client address: IPv4 10.20.193.31:51144 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:05.618411] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:05.618438] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_6, OMAP version: 65 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:05] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:05.710257] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:05.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:05 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:05.710286] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:05.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] INFO state.py:1684 (99): Start update from 63 to 64 (discovery-trial119). 2026-02-18T03:18:05.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] INFO state.py:2068 (99): Update complete (63 -> 64) (discovery-trial119). 2026-02-18T03:18:05.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] INFO state.py:1684 (2): Start update from 63 to 64 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:05.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:05.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:05.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:05.466214] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:05.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] INFO grpc.py:2517 (2): Received request to add bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:18:05.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:05.470727] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:18:05.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:05.470747] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:18:05.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] INFO state.py:2068 (2): Update complete (63 -> 64) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:05.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:05 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.716 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] INFO state.py:1684 (2): Start update from 63 to 64 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] INFO state.py:1684 (144): Start update from 63 to 64 (discovery-trial114). 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] INFO state.py:2068 (144): Update complete (63 -> 64) (discovery-trial114). 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:05.462912] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] INFO grpc.py:2517 (2): Received request to add bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:05.467285] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:18:05.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:05.467308] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:18:05.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] INFO state.py:2068 (2): Update complete (63 -> 64) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:05.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:05 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:05] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.736 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:05.736 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:05.736 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage47 2026-02-18T03:18:05.736 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage47 --load-balancing-group 4 2026-02-18T03:18:05.779 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:05.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] INFO state.py:1684 (2): Start update from 63 to 64 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:05.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] INFO grpc.py:2756 (2): Received request to add namespace 5 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] INFO state.py:1684 (123): Start update from 63 to 64 (discovery-trial194). 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] INFO state.py:2068 (123): Update complete (63 -> 64) (discovery-trial194). 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:05.463165] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] INFO grpc.py:2517 (2): Received request to add bdev_402cc3b0-6b12-4ca1-b0da-5c8f8a9d52dd to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 5, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:05.467561] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:05.467581] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 5 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] INFO state.py:2068 (2): Update complete (63 -> 64) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:05.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:05 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO state.py:1684 (81): Start update from 64 to 65 (discovery-trial097). 2026-02-18T03:18:06.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO state.py:2068 (81): Update complete (64 -> 65) (discovery-trial097). 2026-02-18T03:18:06.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:55788 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage47, no need to remove 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:55788 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:06.311023] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO grpc.py:2517 (2): Received request to add bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: , client address: IPv4 10.20.193.31:55788 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:06.315463] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:06.315485] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_7, OMAP version: 66 2026-02-18T03:18:06.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.407 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.421 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:06.443 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:06.443 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:06.443 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage48 2026-02-18T03:18:06.443 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage48 --load-balancing-group 1 2026-02-18T03:18:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO state.py:1684 (99): Start update from 64 to 65 (discovery-trial119). 2026-02-18T03:18:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO state.py:2068 (99): Update complete (64 -> 65) (discovery-trial119). 2026-02-18T03:18:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO state.py:1684 (2): Start update from 64 to 65 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:06.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:06.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:06.158698] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:06.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO grpc.py:2517 (2): Received request to add bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:18:06.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:06.163115] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:18:06.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:06.163134] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:18:06.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO state.py:2068 (2): Update complete (64 -> 65) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:06.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO state.py:1684 (2): Start update from 64 to 65 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO state.py:1684 (144): Start update from 64 to 65 (discovery-trial114). 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO state.py:2068 (144): Update complete (64 -> 65) (discovery-trial114). 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:06.155340] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO grpc.py:2517 (2): Received request to add bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:06.159708] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:06.159735] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO state.py:2068 (2): Update complete (64 -> 65) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:06.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.482 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:06Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:06.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO state.py:1684 (123): Start update from 64 to 65 (discovery-trial194). 2026-02-18T03:18:06.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO state.py:2068 (123): Update complete (64 -> 65) (discovery-trial194). 2026-02-18T03:18:06.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO state.py:1684 (2): Start update from 64 to 65 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:06.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO grpc.py:2756 (2): Received request to add namespace 6 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:06.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:06.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:06.163730] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:06.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO grpc.py:2517 (2): Received request to add bdev_1210a231-14d2-4e31-ae36-604c10c9ef62 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 6, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:18:06.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:06.168286] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:18:06.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:06.168305] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 6 2026-02-18T03:18:06.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO state.py:2068 (2): Update complete (64 -> 65) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:06.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:06.833 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-mon[24143]: pgmap v115: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1023 KiB/s rd, 4.7 KiB/s wr, 1.01k op/s 2026-02-18T03:18:06.834 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-mon[23907]: pgmap v115: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1023 KiB/s rd, 4.7 KiB/s wr, 1.01k op/s 2026-02-18T03:18:06.837 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-mon[21799]: pgmap v115: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1023 KiB/s rd, 4.7 KiB/s wr, 1.01k op/s 2026-02-18T03:18:06.837 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:06.417173] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:06.837 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:06.417202] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:07.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO state.py:1684 (123): Start update from 65 to 66 (discovery-trial194). 2026-02-18T03:18:07.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO state.py:2068 (123): Update complete (65 -> 66) (discovery-trial194). 2026-02-18T03:18:07.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO state.py:1684 (2): Start update from 65 to 66 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:07.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:07.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:07.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:06.856291] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:07.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO grpc.py:2517 (2): Received request to add bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:18:07.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:06.860712] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:18:07.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:06.860734] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:18:07.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:06 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:06] INFO state.py:2068 (2): Update complete (65 -> 66) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:07.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO state.py:1684 (81): Start update from 65 to 66 (discovery-trial097). 2026-02-18T03:18:07.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO state.py:2068 (81): Update complete (65 -> 66) (discovery-trial097). 2026-02-18T03:18:07.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:39934 2026-02-18T03:18:07.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage48, no need to remove 2026-02-18T03:18:07.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:07.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:06 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:06] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:07.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:39934 2026-02-18T03:18:07.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.044404] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:07.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO grpc.py:2517 (2): Received request to add bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: , client address: IPv4 10.20.193.31:39934 2026-02-18T03:18:07.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.055616] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:18:07.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.055642] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:18:07.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_8, OMAP version: 67 2026-02-18T03:18:07.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.162 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:07.184 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:07.184 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:07.185 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage49 2026-02-18T03:18:07.185 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage49 --load-balancing-group 2 2026-02-18T03:18:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO state.py:1684 (99): Start update from 65 to 66 (discovery-trial119). 2026-02-18T03:18:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO state.py:2068 (99): Update complete (65 -> 66) (discovery-trial119). 2026-02-18T03:18:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO state.py:1684 (2): Start update from 65 to 66 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:06.859700] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO grpc.py:2517 (2): Received request to add bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:18:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:06.864111] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:18:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:06.864133] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:18:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:06 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:06] INFO state.py:2068 (2): Update complete (65 -> 66) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO state.py:1684 (144): Start update from 65 to 66 (discovery-trial114). 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO state.py:2068 (144): Update complete (65 -> 66) (discovery-trial114). 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO state.py:1684 (2): Start update from 65 to 66 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO grpc.py:2756 (2): Received request to add namespace 7 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:06.860803] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO grpc.py:2517 (2): Received request to add bdev_67a66065-5fd6-405e-8bbf-cebe12b487ed to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 7, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:06.865244] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:18:07.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:06.865268] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 7 2026-02-18T03:18:07.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:06 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:06] INFO state.py:2068 (2): Update complete (65 -> 66) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:07.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.227 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:07Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:07.573 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.158313] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:07.573 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.158353] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:07.573 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO state.py:1684 (81): Start update from 66 to 67 (discovery-trial097). 2026-02-18T03:18:07.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO state.py:2068 (81): Update complete (66 -> 67) (discovery-trial097). 2026-02-18T03:18:07.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:42916 2026-02-18T03:18:07.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage49, no need to remove 2026-02-18T03:18:07.860 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_049eac86-2103-48ab-98e7-b296b9a8b704 from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:42916 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.751767] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_049eac86-2103-48ab-98e7-b296b9a8b704 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO grpc.py:2517 (2): Received request to add bdev_049eac86-2103-48ab-98e7-b296b9a8b704 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: , client address: IPv4 10.20.193.31:42916 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.756202] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.756227] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_9, OMAP version: 68 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.858288] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:07.861 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:07 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:07.858319] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:07.863 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:07.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] INFO state.py:1684 (123): Start update from 66 to 67 (discovery-trial194). 2026-02-18T03:18:07.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] INFO state.py:2068 (123): Update complete (66 -> 67) (discovery-trial194). 2026-02-18T03:18:07.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] INFO state.py:1684 (2): Start update from 66 to 67 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:07.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:07.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:07.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:07.594450] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:07.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] INFO grpc.py:2517 (2): Received request to add bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:18:07.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:07.598842] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:18:07.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:07.598864] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:18:07.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] INFO state.py:2068 (2): Update complete (66 -> 67) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:07.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:07 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.890 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:07.890 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:07.890 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage50 2026-02-18T03:18:07.891 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage50 --load-balancing-group 3 2026-02-18T03:18:07.934 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:07Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] INFO state.py:1684 (99): Start update from 66 to 67 (discovery-trial119). 2026-02-18T03:18:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] INFO state.py:2068 (99): Update complete (66 -> 67) (discovery-trial119). 2026-02-18T03:18:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] INFO state.py:1684 (2): Start update from 66 to 67 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:07.597734] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] INFO grpc.py:2517 (2): Received request to add bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:18:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:07.602157] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:18:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:07.602177] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:18:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] INFO state.py:2068 (2): Update complete (66 -> 67) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:07 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] INFO state.py:1684 (2): Start update from 66 to 67 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] INFO grpc.py:2756 (2): Received request to add namespace 8 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] INFO state.py:1684 (144): Start update from 66 to 67 (discovery-trial114). 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] INFO state.py:2068 (144): Update complete (66 -> 67) (discovery-trial114). 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:07.594791] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] INFO grpc.py:2517 (2): Received request to add bdev_99fda052-b1ae-4422-98ae-7ede3692abc9 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 8, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:07.599246] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:07.599272] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 8 2026-02-18T03:18:07.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] INFO state.py:2068 (2): Update complete (66 -> 67) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:07.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:07.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:07] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:08.560 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-mon[21799]: pgmap v116: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.2 KiB/s wr, 1.18k op/s 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO state.py:1684 (81): Start update from 67 to 68 (discovery-trial097). 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO state.py:2068 (81): Update complete (67 -> 68) (discovery-trial097). 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:41056 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage50, no need to remove 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_485a9615-643b-41d3-ac1e-63515fce124c from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:41056 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:08.458845] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_485a9615-643b-41d3-ac1e-63515fce124c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:08.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO grpc.py:2517 (2): Received request to add bdev_485a9615-643b-41d3-ac1e-63515fce124c to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: , client address: IPv4 10.20.193.31:41056 2026-02-18T03:18:08.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:08.463308] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:18:08.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:08.463334] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:18:08.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_10, OMAP version: 69 2026-02-18T03:18:08.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:08.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:08.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:08.558637] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:08.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:08.558664] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:08.563 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:08.583 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:08.584 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:08.584 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage51 2026-02-18T03:18:08.584 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage51 --load-balancing-group 4 2026-02-18T03:18:08.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO state.py:1684 (123): Start update from 67 to 68 (discovery-trial194). 2026-02-18T03:18:08.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO state.py:2068 (123): Update complete (67 -> 68) (discovery-trial194). 2026-02-18T03:18:08.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO state.py:1684 (2): Start update from 67 to 68 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:08.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:08.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_049eac86-2103-48ab-98e7-b296b9a8b704 from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:08.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:08.296785] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_049eac86-2103-48ab-98e7-b296b9a8b704 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:08.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO grpc.py:2517 (2): Received request to add bdev_049eac86-2103-48ab-98e7-b296b9a8b704 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:18:08.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:08.301136] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:18:08.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:08.301156] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:18:08.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO state.py:2068 (2): Update complete (67 -> 68) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:08.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:08.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:08.632 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:08.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-mon[24143]: pgmap v116: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.2 KiB/s wr, 1.18k op/s 2026-02-18T03:18:08.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO state.py:1684 (99): Start update from 67 to 68 (discovery-trial119). 2026-02-18T03:18:08.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO state.py:2068 (99): Update complete (67 -> 68) (discovery-trial119). 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO state.py:1684 (2): Start update from 67 to 68 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_049eac86-2103-48ab-98e7-b296b9a8b704 from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:08.302824] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_049eac86-2103-48ab-98e7-b296b9a8b704 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO grpc.py:2517 (2): Received request to add bdev_049eac86-2103-48ab-98e7-b296b9a8b704 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:08.307218] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:08.307237] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO state.py:2068 (2): Update complete (67 -> 68) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:08.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-mon[23907]: pgmap v116: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.2 KiB/s wr, 1.18k op/s 2026-02-18T03:18:08.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO state.py:1684 (2): Start update from 67 to 68 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:08.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO grpc.py:2756 (2): Received request to add namespace 9 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:08.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_049eac86-2103-48ab-98e7-b296b9a8b704 from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:08.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO state.py:1684 (144): Start update from 67 to 68 (discovery-trial114). 2026-02-18T03:18:08.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO state.py:2068 (144): Update complete (67 -> 68) (discovery-trial114). 2026-02-18T03:18:08.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:08.296777] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_049eac86-2103-48ab-98e7-b296b9a8b704 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:08.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO grpc.py:2517 (2): Received request to add bdev_049eac86-2103-48ab-98e7-b296b9a8b704 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 9, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:18:08.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:08.301172] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:18:08.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:08.301202] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 9 2026-02-18T03:18:08.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO state.py:2068 (2): Update complete (67 -> 68) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:08.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:08.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO state.py:1684 (81): Start update from 68 to 69 (discovery-trial097). 2026-02-18T03:18:09.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:08 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:08] INFO state.py:2068 (81): Update complete (68 -> 69) (discovery-trial097). 2026-02-18T03:18:09.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:52766 2026-02-18T03:18:09.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage51, no need to remove 2026-02-18T03:18:09.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:09.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:52766 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.155571] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO grpc.py:2517 (2): Received request to add bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: , client address: IPv4 10.20.193.31:52766 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.159979] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.160003] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_11, OMAP version: 70 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.256154] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:09.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.256180] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:09.261 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:09.282 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:09.283 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:09.283 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage52 2026-02-18T03:18:09.283 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage52 --load-balancing-group 1 2026-02-18T03:18:09.322 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:09Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:09.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO state.py:1684 (123): Start update from 68 to 69 (discovery-trial194). 2026-02-18T03:18:09.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO state.py:2068 (123): Update complete (68 -> 69) (discovery-trial194). 2026-02-18T03:18:09.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO state.py:1684 (2): Start update from 68 to 69 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:09.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:09.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:08 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_485a9615-643b-41d3-ac1e-63515fce124c from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:09.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:09.005842] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_485a9615-643b-41d3-ac1e-63515fce124c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:09.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO grpc.py:2517 (2): Received request to add bdev_485a9615-643b-41d3-ac1e-63515fce124c to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:18:09.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:09.010405] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:18:09.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:09.010427] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:18:09.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO state.py:2068 (2): Update complete (68 -> 69) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:09.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO state.py:1684 (99): Start update from 68 to 69 (discovery-trial119). 2026-02-18T03:18:09.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO state.py:2068 (99): Update complete (68 -> 69) (discovery-trial119). 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO state.py:1684 (2): Start update from 68 to 69 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:08 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_485a9615-643b-41d3-ac1e-63515fce124c from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:09.008161] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_485a9615-643b-41d3-ac1e-63515fce124c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO grpc.py:2517 (2): Received request to add bdev_485a9615-643b-41d3-ac1e-63515fce124c to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:09.012677] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:09.012707] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO state.py:2068 (2): Update complete (68 -> 69) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO state.py:1684 (144): Start update from 68 to 69 (discovery-trial114). 2026-02-18T03:18:09.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO state.py:2068 (144): Update complete (68 -> 69) (discovery-trial114). 2026-02-18T03:18:09.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO state.py:1684 (2): Start update from 68 to 69 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:09.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO grpc.py:2756 (2): Received request to add namespace 10 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:09.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:08 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_485a9615-643b-41d3-ac1e-63515fce124c from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:09.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:09.001930] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_485a9615-643b-41d3-ac1e-63515fce124c rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:09.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO grpc.py:2517 (2): Received request to add bdev_485a9615-643b-41d3-ac1e-63515fce124c to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 10, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:18:09.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:09.006524] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:18:09.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:09.006548] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 10 2026-02-18T03:18:09.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO state.py:2068 (2): Update complete (68 -> 69) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:09.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO state.py:1684 (99): Start update from 69 to 70 (discovery-trial119). 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO state.py:1684 (2): Start update from 69 to 70 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO state.py:2068 (99): Update complete (69 -> 70) (discovery-trial119). 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:09.705205] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO grpc.py:2517 (2): Received request to add bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:09.709712] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:09.709734] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:18:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] INFO state.py:2068 (2): Update complete (69 -> 70) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:09.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:09 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO state.py:1684 (81): Start update from 69 to 70 (discovery-trial097). 2026-02-18T03:18:09.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO state.py:2068 (81): Update complete (69 -> 70) (discovery-trial097). 2026-02-18T03:18:09.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:50854 2026-02-18T03:18:09.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage52, no need to remove 2026-02-18T03:18:09.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:09.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:09.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:50854 2026-02-18T03:18:09.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.861125] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:09.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO grpc.py:2517 (2): Received request to add bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: , client address: IPv4 10.20.193.31:50854 2026-02-18T03:18:09.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.865707] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:18:09.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.865733] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:18:09.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_12, OMAP version: 71 2026-02-18T03:18:09.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.967127] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:09.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:09 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:09.967158] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:09.972 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO state.py:1684 (2): Start update from 69 to 70 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO state.py:1684 (144): Start update from 69 to 70 (discovery-trial114). 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO state.py:2068 (144): Update complete (69 -> 70) (discovery-trial114). 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:09.700250] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO grpc.py:2517 (2): Received request to add bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:09.704863] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:09.704901] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:18:09.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] INFO state.py:2068 (2): Update complete (69 -> 70) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:09.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:09 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:09] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:09.992 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:09.992 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:09.992 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage53 2026-02-18T03:18:09.992 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage53 --load-balancing-group 2 2026-02-18T03:18:10.025 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:10Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:10.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO state.py:1684 (123): Start update from 69 to 70 (discovery-trial194). 2026-02-18T03:18:10.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO state.py:2068 (123): Update complete (69 -> 70) (discovery-trial194). 2026-02-18T03:18:10.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO state.py:1684 (2): Start update from 69 to 70 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:10.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO grpc.py:2756 (2): Received request to add namespace 11 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:10.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:10.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:09.702628] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:10.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO grpc.py:2517 (2): Received request to add bdev_579054f5-d0d9-4b36-8fcc-5f70e57dd7e5 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 11, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:18:10.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:09.707092] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:18:10.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:09.707115] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 11 2026-02-18T03:18:10.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] INFO state.py:2068 (2): Update complete (69 -> 70) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:10.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:09 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.636 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:10.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-mon[21799]: pgmap v117: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 6.0 KiB/s wr, 1.08k op/s 2026-02-18T03:18:10.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3163756679' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:10.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO state.py:1684 (81): Start update from 70 to 71 (discovery-trial097). 2026-02-18T03:18:10.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO state.py:2068 (81): Update complete (70 -> 71) (discovery-trial097). 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:60304 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage53, no need to remove 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:60304 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:10.528245] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO grpc.py:2517 (2): Received request to add bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: , client address: IPv4 10.20.193.31:60304 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:10.532723] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:10.532747] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_13, OMAP version: 72 2026-02-18T03:18:10.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:10] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:10.631746] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:10.657 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:10 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:10.631774] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:10.660 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:10.660 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:10.660 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage54 2026-02-18T03:18:10.660 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage54 --load-balancing-group 3 2026-02-18T03:18:10.699 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:10Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:10.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-mon[24143]: pgmap v117: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 6.0 KiB/s wr, 1.08k op/s 2026-02-18T03:18:10.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3163756679' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:10.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] INFO state.py:1684 (99): Start update from 70 to 71 (discovery-trial119). 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] INFO state.py:2068 (99): Update complete (70 -> 71) (discovery-trial119). 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] INFO state.py:1684 (2): Start update from 70 to 71 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:10.410737] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] INFO grpc.py:2517 (2): Received request to add bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:10.415183] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:10.415207] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] INFO state.py:2068 (2): Update complete (70 -> 71) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:10 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-mon[23907]: pgmap v117: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 6.0 KiB/s wr, 1.08k op/s 2026-02-18T03:18:10.724 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3163756679' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:10.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] INFO state.py:1684 (2): Start update from 70 to 71 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:10.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:10.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:10.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] INFO state.py:1684 (144): Start update from 70 to 71 (discovery-trial114). 2026-02-18T03:18:10.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] INFO state.py:2068 (144): Update complete (70 -> 71) (discovery-trial114). 2026-02-18T03:18:10.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:10.412238] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:10.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] INFO grpc.py:2517 (2): Received request to add bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:18:10.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:10.426477] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:18:10.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:10.426512] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:18:10.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] INFO state.py:2068 (2): Update complete (70 -> 71) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:10.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:10 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:10] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] INFO state.py:1684 (123): Start update from 70 to 71 (discovery-trial194). 2026-02-18T03:18:10.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] INFO state.py:2068 (123): Update complete (70 -> 71) (discovery-trial194). 2026-02-18T03:18:10.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] INFO state.py:1684 (2): Start update from 70 to 71 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:10.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] INFO grpc.py:2756 (2): Received request to add namespace 12 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:10.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:10.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:10.406939] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:10.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] INFO grpc.py:2517 (2): Received request to add bdev_b084ea7b-a563-4601-8e86-9a72892bb5e7 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 12, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:18:10.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:10.411364] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:18:10.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:10.411386] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 12 2026-02-18T03:18:10.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] INFO state.py:2068 (2): Update complete (70 -> 71) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:10.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:10.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:10 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:10] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO state.py:1684 (81): Start update from 71 to 72 (discovery-trial097). 2026-02-18T03:18:11.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO state.py:2068 (81): Update complete (71 -> 72) (discovery-trial097). 2026-02-18T03:18:11.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:51036 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage54, no need to remove 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb3e8988-5f46-4725-9715-885387e6b424 from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:51036 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:11.241802] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb3e8988-5f46-4725-9715-885387e6b424 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO grpc.py:2517 (2): Received request to add bdev_fb3e8988-5f46-4725-9715-885387e6b424 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: , client address: IPv4 10.20.193.31:51036 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:11.246282] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:11.246306] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_14, OMAP version: 73 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.343 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:11.339277] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:11.343 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:11.339306] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:11.344 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:11.365 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:11.366 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:11.366 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage55 2026-02-18T03:18:11.366 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage55 --load-balancing-group 4 2026-02-18T03:18:11.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO state.py:1684 (2): Start update from 71 to 72 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:11.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:11.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:11.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO state.py:1684 (123): Start update from 71 to 72 (discovery-trial194). 2026-02-18T03:18:11.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO state.py:2068 (123): Update complete (71 -> 72) (discovery-trial194). 2026-02-18T03:18:11.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:11.071955] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:11.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO grpc.py:2517 (2): Received request to add bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:18:11.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:11.076344] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:18:11.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:11.076368] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:18:11.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO state.py:2068 (2): Update complete (71 -> 72) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:11.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.410 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:11Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO state.py:1684 (99): Start update from 71 to 72 (discovery-trial119). 2026-02-18T03:18:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO state.py:2068 (99): Update complete (71 -> 72) (discovery-trial119). 2026-02-18T03:18:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO state.py:1684 (2): Start update from 71 to 72 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:11.076730] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO grpc.py:2517 (2): Received request to add bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:11.084984] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:11.085008] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO state.py:2068 (2): Update complete (71 -> 72) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO state.py:1684 (2): Start update from 71 to 72 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO grpc.py:2756 (2): Received request to add namespace 13 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO state.py:1684 (144): Start update from 71 to 72 (discovery-trial114). 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO state.py:2068 (144): Update complete (71 -> 72) (discovery-trial114). 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:11.073732] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO grpc.py:2517 (2): Received request to add bdev_b930868d-a5e7-46ac-b0f6-02c63d7e8246 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 13, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:11.078141] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:11.078169] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 13 2026-02-18T03:18:11.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO state.py:2068 (2): Update complete (71 -> 72) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:11.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:11.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1437551777' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:11.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/232878610' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:11.765 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1437551777' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:11.765 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/232878610' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:11.766 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1437551777' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:11.766 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/232878610' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:12.057 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO state.py:1684 (81): Start update from 72 to 73 (discovery-trial097). 2026-02-18T03:18:12.057 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO state.py:2068 (81): Update complete (72 -> 73) (discovery-trial097). 2026-02-18T03:18:12.057 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:34216 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage55, no need to remove 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:34216 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:11.952264] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO grpc.py:2517 (2): Received request to add bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: , client address: IPv4 10.20.193.31:34216 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:11.956721] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:11.956746] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_15, OMAP version: 74 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:11 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:11] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.058 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:12.055214] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:12.059 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:12.055245] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:12.060 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:12.086 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:12.086 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:12.086 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage56 2026-02-18T03:18:12.086 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage56 --load-balancing-group 1 2026-02-18T03:18:12.129 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:12Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:12.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO state.py:1684 (2): Start update from 72 to 73 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:12.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:12.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb3e8988-5f46-4725-9715-885387e6b424 from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:12.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO state.py:1684 (123): Start update from 72 to 73 (discovery-trial194). 2026-02-18T03:18:12.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO state.py:2068 (123): Update complete (72 -> 73) (discovery-trial194). 2026-02-18T03:18:12.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:11.789172] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb3e8988-5f46-4725-9715-885387e6b424 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:12.131 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO grpc.py:2517 (2): Received request to add bdev_fb3e8988-5f46-4725-9715-885387e6b424 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:18:12.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:11.793570] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:18:12.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:11.793592] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:18:12.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] INFO state.py:2068 (2): Update complete (72 -> 73) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:12.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:11 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:11] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO state.py:1684 (99): Start update from 72 to 73 (discovery-trial119). 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO state.py:2068 (99): Update complete (72 -> 73) (discovery-trial119). 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO state.py:1684 (2): Start update from 72 to 73 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb3e8988-5f46-4725-9715-885387e6b424 from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:11.798764] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb3e8988-5f46-4725-9715-885387e6b424 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO grpc.py:2517 (2): Received request to add bdev_fb3e8988-5f46-4725-9715-885387e6b424 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:11.803282] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:11.803307] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] INFO state.py:2068 (2): Update complete (72 -> 73) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:11 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:11] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO state.py:1684 (2): Start update from 72 to 73 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO grpc.py:2756 (2): Received request to add namespace 14 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb3e8988-5f46-4725-9715-885387e6b424 from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO state.py:1684 (144): Start update from 72 to 73 (discovery-trial114). 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO state.py:2068 (144): Update complete (72 -> 73) (discovery-trial114). 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:11.791835] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb3e8988-5f46-4725-9715-885387e6b424 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO grpc.py:2517 (2): Received request to add bdev_fb3e8988-5f46-4725-9715-885387e6b424 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 14, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:11.796253] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:18:12.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:11.796278] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 14 2026-02-18T03:18:12.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] INFO state.py:2068 (2): Update complete (72 -> 73) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:12.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:11 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:11] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.676 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-mon[24143]: pgmap v118: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 4.7 KiB/s wr, 1k op/s 2026-02-18T03:18:12.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] INFO state.py:1684 (2): Start update from 73 to 74 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:12.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:12.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:12.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] INFO state.py:1684 (99): Start update from 73 to 74 (discovery-trial119). 2026-02-18T03:18:12.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] INFO state.py:2068 (99): Update complete (73 -> 74) (discovery-trial119). 2026-02-18T03:18:12.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:12.495710] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:12.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] INFO grpc.py:2517 (2): Received request to add bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:18:12.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:12.500293] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:18:12.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:12.500317] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:18:12.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] INFO state.py:2068 (2): Update complete (73 -> 74) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:12.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.769 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-mon[21799]: pgmap v118: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 4.7 KiB/s wr, 1k op/s 2026-02-18T03:18:12.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO state.py:1684 (81): Start update from 73 to 74 (discovery-trial097). 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO state.py:2068 (81): Update complete (73 -> 74) (discovery-trial097). 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:60934 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage56, no need to remove 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:60934 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:12.660835] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO grpc.py:2517 (2): Received request to add bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: , client address: IPv4 10.20.193.31:60934 2026-02-18T03:18:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:12.665286] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:18:12.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:12.665313] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:18:12.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_16, OMAP version: 75 2026-02-18T03:18:12.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:12] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:12.767445] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:12.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:12 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:12.767475] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:12.772 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:12.793 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:12.793 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:12.793 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage57 2026-02-18T03:18:12.794 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage57 --load-balancing-group 2 2026-02-18T03:18:12.826 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:12Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:12.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] INFO state.py:1684 (2): Start update from 73 to 74 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:12.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:12.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:12.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] INFO state.py:1684 (123): Start update from 73 to 74 (discovery-trial194). 2026-02-18T03:18:12.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] INFO state.py:2068 (123): Update complete (73 -> 74) (discovery-trial194). 2026-02-18T03:18:12.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:12.499040] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:12.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] INFO grpc.py:2517 (2): Received request to add bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:18:12.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:12.503483] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:18:12.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:12.503503] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:18:12.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] INFO state.py:2068 (2): Update complete (73 -> 74) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:12.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:12 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:12 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-mon[23907]: pgmap v118: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 4.7 KiB/s wr, 1k op/s 2026-02-18T03:18:12.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] INFO state.py:1684 (2): Start update from 73 to 74 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:12.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] INFO grpc.py:2756 (2): Received request to add namespace 15 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:12.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:12.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] INFO state.py:1684 (144): Start update from 73 to 74 (discovery-trial114). 2026-02-18T03:18:12.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] INFO state.py:2068 (144): Update complete (73 -> 74) (discovery-trial114). 2026-02-18T03:18:12.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:12.497446] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:12.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] INFO grpc.py:2517 (2): Received request to add bdev_a2d7df52-a29f-4d2b-a6ce-32e661925ee0 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 15, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:18:12.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:12.502706] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:18:12.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:12.502734] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 15 2026-02-18T03:18:12.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] INFO state.py:2068 (2): Update complete (73 -> 74) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:12.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:12.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:12 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO state.py:1684 (99): Start update from 74 to 75 (discovery-trial119). 2026-02-18T03:18:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO state.py:2068 (99): Update complete (74 -> 75) (discovery-trial119). 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO state.py:1684 (2): Start update from 74 to 75 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:13.213070] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO grpc.py:2517 (2): Received request to add bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:13.217596] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:13.217619] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO state.py:2068 (2): Update complete (74 -> 75) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO state.py:1684 (144): Start update from 74 to 75 (discovery-trial114). 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO state.py:2068 (144): Update complete (74 -> 75) (discovery-trial114). 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO state.py:1684 (2): Start update from 74 to 75 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:13.207522] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO grpc.py:2517 (2): Received request to add bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:13.212011] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:13.212036] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:18:13.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO state.py:2068 (2): Update complete (74 -> 75) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:13.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:13.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:13.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO state.py:1684 (81): Start update from 74 to 75 (discovery-trial097). 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO state.py:2068 (81): Update complete (74 -> 75) (discovery-trial097). 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:39184 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage57, no need to remove 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:39184 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:13.368252] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO grpc.py:2517 (2): Received request to add bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: , client address: IPv4 10.20.193.31:39184 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:13.372716] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:13.372741] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:18:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_17, OMAP version: 76 2026-02-18T03:18:13.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:13.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:13.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:13.475708] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:13.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:13.475738] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:13.480 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:13.501 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:13.501 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:13.501 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage58 2026-02-18T03:18:13.502 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage58 --load-balancing-group 3 2026-02-18T03:18:13.530 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:13Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:13.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO state.py:1684 (123): Start update from 74 to 75 (discovery-trial194). 2026-02-18T03:18:13.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO state.py:2068 (123): Update complete (74 -> 75) (discovery-trial194). 2026-02-18T03:18:13.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO state.py:1684 (2): Start update from 74 to 75 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:13.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO grpc.py:2756 (2): Received request to add namespace 16 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:13.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:13.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:13.211592] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:13.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO grpc.py:2517 (2): Received request to add bdev_f3e15f34-e41e-4a5b-9b7e-e0f307ec648f to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 16, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:18:13.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:13.216016] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:18:13.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:13.216036] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 16 2026-02-18T03:18:13.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO state.py:2068 (2): Update complete (74 -> 75) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:13.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:13.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO state.py:1684 (81): Start update from 75 to 76 (discovery-trial097). 2026-02-18T03:18:14.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO state.py:2068 (81): Update complete (75 -> 76) (discovery-trial097). 2026-02-18T03:18:14.155 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:55716 2026-02-18T03:18:14.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage58, no need to remove 2026-02-18T03:18:14.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:14.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:13 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:13] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:14.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_44e928ce-48df-4f10-99e0-10980c7f1baa from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:55716 2026-02-18T03:18:14.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.061860] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_44e928ce-48df-4f10-99e0-10980c7f1baa rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:14.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO grpc.py:2517 (2): Received request to add bdev_44e928ce-48df-4f10-99e0-10980c7f1baa to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: , client address: IPv4 10.20.193.31:55716 2026-02-18T03:18:14.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.066306] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:18:14.156 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.066332] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:18:14.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_18, OMAP version: 77 2026-02-18T03:18:14.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.164 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:14.184 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:14.184 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:14.184 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage59 2026-02-18T03:18:14.184 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage59 --load-balancing-group 4 2026-02-18T03:18:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO state.py:1684 (99): Start update from 75 to 76 (discovery-trial119). 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO state.py:2068 (99): Update complete (75 -> 76) (discovery-trial119). 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO state.py:1684 (2): Start update from 75 to 76 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:13.922127] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO grpc.py:2517 (2): Received request to add bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:13.926781] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:13.926803] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:13] INFO state.py:2068 (2): Update complete (75 -> 76) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.223 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:14Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:14.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO state.py:1684 (2): Start update from 75 to 76 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:14.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:14.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:14.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO state.py:1684 (144): Start update from 75 to 76 (discovery-trial114). 2026-02-18T03:18:14.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO state.py:2068 (144): Update complete (75 -> 76) (discovery-trial114). 2026-02-18T03:18:14.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:13.913287] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:14.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO grpc.py:2517 (2): Received request to add bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:18:14.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:13.917883] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:18:14.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:13.917907] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:18:14.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:13 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:13] INFO state.py:2068 (2): Update complete (75 -> 76) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:14.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO state.py:1684 (123): Start update from 75 to 76 (discovery-trial194). 2026-02-18T03:18:14.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO state.py:2068 (123): Update complete (75 -> 76) (discovery-trial194). 2026-02-18T03:18:14.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO state.py:1684 (2): Start update from 75 to 76 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:14.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO grpc.py:2756 (2): Received request to add namespace 17 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:14.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:14.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:13.913982] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:14.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO grpc.py:2517 (2): Received request to add bdev_26d67987-d1b6-4e7f-95cb-0aa88b14511a to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 17, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:18:14.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:13.918426] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:18:14.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:13.918455] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 17 2026-02-18T03:18:14.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:13 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:13] INFO state.py:2068 (2): Update complete (75 -> 76) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:14.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.159194] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:14.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.159222] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:14.830 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-mon[21799]: pgmap v119: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.4 MiB/s rd, 6.7 KiB/s wr, 1.33k op/s 2026-02-18T03:18:14.830 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/721169731' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:14.830 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO state.py:1684 (81): Start update from 76 to 77 (discovery-trial097). 2026-02-18T03:18:14.830 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO state.py:2068 (81): Update complete (76 -> 77) (discovery-trial097). 2026-02-18T03:18:14.830 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:40120 2026-02-18T03:18:14.830 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage59, no need to remove 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:40120 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.727577] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO grpc.py:2517 (2): Received request to add bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: , client address: IPv4 10.20.193.31:40120 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.732045] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.732072] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_19, OMAP version: 78 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:14] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.831 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.828169] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:14.832 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:14 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:14.828204] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:14.832 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:14.859 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:14.859 INFO:tasks.workunit.client.0.trial031.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:18:14.859 INFO:tasks.workunit.client.0.trial031.stderr:+ image=myimage60 2026-02-18T03:18:14.859 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage60 --load-balancing-group 1 2026-02-18T03:18:14.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] INFO state.py:1684 (123): Start update from 76 to 77 (discovery-trial194). 2026-02-18T03:18:14.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] INFO state.py:2068 (123): Update complete (76 -> 77) (discovery-trial194). 2026-02-18T03:18:14.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] INFO state.py:1684 (2): Start update from 76 to 77 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:14.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:14.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_44e928ce-48df-4f10-99e0-10980c7f1baa from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:14.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:14.616675] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_44e928ce-48df-4f10-99e0-10980c7f1baa rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:14.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] INFO grpc.py:2517 (2): Received request to add bdev_44e928ce-48df-4f10-99e0-10980c7f1baa to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:18:14.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:14.621096] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:18:14.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:14.621118] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:18:14.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] INFO state.py:2068 (2): Update complete (76 -> 77) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:14.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:14 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:14] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.892 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:14Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-mon[24143]: pgmap v119: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.4 MiB/s rd, 6.7 KiB/s wr, 1.33k op/s 2026-02-18T03:18:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/721169731' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:14.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] INFO state.py:1684 (99): Start update from 76 to 77 (discovery-trial119). 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] INFO state.py:2068 (99): Update complete (76 -> 77) (discovery-trial119). 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] INFO state.py:1684 (2): Start update from 76 to 77 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_44e928ce-48df-4f10-99e0-10980c7f1baa from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:14.616738] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_44e928ce-48df-4f10-99e0-10980c7f1baa rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] INFO grpc.py:2517 (2): Received request to add bdev_44e928ce-48df-4f10-99e0-10980c7f1baa to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:14.625890] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:14.625912] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] INFO state.py:2068 (2): Update complete (76 -> 77) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:14 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-mon[23907]: pgmap v119: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.4 MiB/s rd, 6.7 KiB/s wr, 1.33k op/s 2026-02-18T03:18:14.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/721169731' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:14.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] INFO state.py:1684 (144): Start update from 76 to 77 (discovery-trial114). 2026-02-18T03:18:14.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] INFO state.py:2068 (144): Update complete (76 -> 77) (discovery-trial114). 2026-02-18T03:18:14.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] INFO state.py:1684 (2): Start update from 76 to 77 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:14.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] INFO grpc.py:2756 (2): Received request to add namespace 18 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:14.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_44e928ce-48df-4f10-99e0-10980c7f1baa from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:14.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:14.614723] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_44e928ce-48df-4f10-99e0-10980c7f1baa rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:14.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] INFO grpc.py:2517 (2): Received request to add bdev_44e928ce-48df-4f10-99e0-10980c7f1baa to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 18, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:18:14.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:14.619327] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:18:14.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:14.619351] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 18 2026-02-18T03:18:14.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] INFO state.py:2068 (2): Update complete (76 -> 77) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:14.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:14.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:14 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:14] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:15.553 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO state.py:1684 (81): Start update from 77 to 78 (discovery-trial097). 2026-02-18T03:18:15.553 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO state.py:2068 (81): Update complete (77 -> 78) (discovery-trial097). 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.31:52878 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage60, no need to remove 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.31:52878 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:15.457570] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO grpc.py:2517 (2): Received request to add bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: , client address: IPv4 10.20.193.31:52878 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:15.462097] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:15.462123] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:18:15.554 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_20, OMAP version: 79 2026-02-18T03:18:15.555 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:15.555 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] WARNING state.py:640 (81): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:15.555 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:15.551541] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:18:15.555 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [2026-02-18 03:18:15.551576] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:18:15.556 INFO:tasks.workunit.client.0.trial031.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:18:15.578 INFO:tasks.workunit.client.0.trial031.stderr:+ (( image_index++ )) 2026-02-18T03:18:15.578 INFO:tasks.workunit.client.0.trial031.stderr:+ list_subsystems 2026-02-18T03:18:15.578 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:18:15.579 INFO:tasks.workunit.client.0.trial031.stderr:+ ip=10.20.193.97 2026-02-18T03:18:15.579 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.97 --server-port 5500 --format json subsystem list 2026-02-18T03:18:15.617 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:15Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:15.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO state.py:1684 (2): Start update from 77 to 78 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:15.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:15.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:15.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO state.py:1684 (123): Start update from 77 to 78 (discovery-trial194). 2026-02-18T03:18:15.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO state.py:2068 (123): Update complete (77 -> 78) (discovery-trial194). 2026-02-18T03:18:15.631 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:15.277933] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO grpc.py:2517 (2): Received request to add bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:18:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:15.282320] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:18:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:15.282339] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:18:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO state.py:2068 (2): Update complete (77 -> 78) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] WARNING state.py:640 (123): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:15.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO state.py:1684 (99): Start update from 77 to 78 (discovery-trial119). 2026-02-18T03:18:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO state.py:2068 (99): Update complete (77 -> 78) (discovery-trial119). 2026-02-18T03:18:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO state.py:1684 (2): Start update from 77 to 78 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:15.278810] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO grpc.py:2517 (2): Received request to add bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:18:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:15.283401] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:18:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:15.283423] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:18:15.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO state.py:2068 (2): Update complete (77 -> 78) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:15.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:15.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] WARNING state.py:640 (99): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:15.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO state.py:1684 (2): Start update from 77 to 78 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:15.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO grpc.py:2756 (2): Received request to add namespace 19 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:15.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:15.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO state.py:1684 (144): Start update from 77 to 78 (discovery-trial114). 2026-02-18T03:18:15.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO state.py:2068 (144): Update complete (77 -> 78) (discovery-trial114). 2026-02-18T03:18:15.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:15.275533] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:15.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO grpc.py:2517 (2): Received request to add bdev_9db4a372-dca2-4b6b-bc23-82aad53061e0 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 19, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:18:15.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:15.279990] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:18:15.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:15.280017] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 19 2026-02-18T03:18:15.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO state.py:2068 (2): Update complete (77 -> 78) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:15.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:15.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] WARNING state.py:640 (144): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:18:16.073 INFO:tasks.workunit.client.0.trial031.stdout:{ 2026-02-18T03:18:16.073 INFO:tasks.workunit.client.0.trial031.stdout: "error_message": "Success", 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "subsystems": [ 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph163465633537", 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 1, 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 2040, 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:16.074 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: }, 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph23661839356249", 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 1, 2026-02-18T03:18:16.075 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 2040, 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: }, 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph9703392782333", 2026-02-18T03:18:16.076 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 1, 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 2040, 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: } 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: ], 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout: "status": 0 2026-02-18T03:18:16.077 INFO:tasks.workunit.client.0.trial031.stdout:} 2026-02-18T03:18:16.092 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:18:16.092 INFO:tasks.workunit.client.0.trial031.stderr:+ ip=10.20.193.114 2026-02-18T03:18:16.092 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.114 --server-port 5500 --format json subsystem list 2026-02-18T03:18:16.136 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO state.py:1684 (123): Start update from 78 to 79 (discovery-trial194). 2026-02-18T03:18:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO state.py:2068 (123): Update complete (78 -> 79) (discovery-trial194). 2026-02-18T03:18:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO state.py:1684 (2): Start update from 78 to 79 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:15 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:16 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:16.008401] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:16 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:16] INFO grpc.py:2517 (2): Received request to add bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:18:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:16 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:16.012831] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:18:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:16 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [2026-02-18 03:18:16.012854] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:18:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:16 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:16] INFO state.py:2068 (2): Update complete (78 -> 79) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:18:16.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO state.py:1684 (81): Start update from 78 to 79 (discovery-trial097). 2026-02-18T03:18:16.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:15 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:15] INFO state.py:2068 (81): Update complete (78 -> 79) (discovery-trial097). 2026-02-18T03:18:16.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:16 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:16] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.31:52548 2026-02-18T03:18:16.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO state.py:1684 (2): Start update from 78 to 79 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:16.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:16.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:16.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO state.py:1684 (99): Start update from 78 to 79 (discovery-trial119). 2026-02-18T03:18:16.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:15 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:15] INFO state.py:2068 (99): Update complete (78 -> 79) (discovery-trial119). 2026-02-18T03:18:16.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:16 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:16.005729] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:16.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:16 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:16] INFO grpc.py:2517 (2): Received request to add bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:18:16.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:16 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:16.012951] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:18:16.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:16 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [2026-02-18 03:18:16.012971] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:18:16.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:16 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:16] INFO state.py:2068 (2): Update complete (78 -> 79) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO state.py:1684 (2): Start update from 78 to 79 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO grpc.py:2756 (2): Received request to add namespace 20 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO state.py:1684 (144): Start update from 78 to 79 (discovery-trial114). 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:15 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:15] INFO state.py:2068 (144): Update complete (78 -> 79) (discovery-trial114). 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:16 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:16.002390] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 rbd disk to lun , cluster-id eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:16 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:16] INFO grpc.py:2517 (2): Received request to add bdev_45ce2248-cf48-47af-ad10-82d98dc632f4 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 20, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:16 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:16.007021] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:16 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [2026-02-18 03:18:16.007044] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 20 2026-02-18T03:18:16.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:16 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:16] INFO state.py:2068 (2): Update complete (78 -> 79) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout:{ 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: "error_message": "Success", 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: "subsystems": [ 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph163465633537", 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 2041, 2026-02-18T03:18:16.583 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 4080, 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: }, 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:16.584 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph23661839356249", 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 2041, 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 4080, 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: }, 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:16.585 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph9703392782333", 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 2041, 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 4080, 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:16.586 INFO:tasks.workunit.client.0.trial031.stdout: } 2026-02-18T03:18:16.587 INFO:tasks.workunit.client.0.trial031.stdout: ], 2026-02-18T03:18:16.587 INFO:tasks.workunit.client.0.trial031.stdout: "status": 0 2026-02-18T03:18:16.587 INFO:tasks.workunit.client.0.trial031.stdout:} 2026-02-18T03:18:16.601 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:18:16.601 INFO:tasks.workunit.client.0.trial031.stderr:+ ip=10.20.193.119 2026-02-18T03:18:16.601 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.119 --server-port 5500 --format json subsystem list 2026-02-18T03:18:16.639 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:16.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:16 trial097 ceph-mon[21799]: pgmap v120: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.06k op/s 2026-02-18T03:18:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:16 trial119 ceph-mon[24143]: pgmap v120: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.06k op/s 2026-02-18T03:18:16.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:18:16 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:18:16] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.31:51920 2026-02-18T03:18:16.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:16 trial114 ceph-mon[23907]: pgmap v120: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.06k op/s 2026-02-18T03:18:17.086 INFO:tasks.workunit.client.0.trial031.stdout:{ 2026-02-18T03:18:17.086 INFO:tasks.workunit.client.0.trial031.stdout: "error_message": "Success", 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "subsystems": [ 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph163465633537", 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 4081, 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 6120, 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:17.087 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: }, 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph23661839356249", 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 4081, 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 6120, 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:17.088 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: }, 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph9703392782333", 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 4081, 2026-02-18T03:18:17.089 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 6120, 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: } 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: ], 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout: "status": 0 2026-02-18T03:18:17.090 INFO:tasks.workunit.client.0.trial031.stdout:} 2026-02-18T03:18:17.104 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:18:17.104 INFO:tasks.workunit.client.0.trial031.stderr:+ ip=10.20.193.194 2026-02-18T03:18:17.104 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.194 --server-port 5500 --format json subsystem list 2026-02-18T03:18:17.142 INFO:tasks.workunit.client.0.trial031.stderr:time="2026-02-18T03:18:17Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:18:17.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:18:17 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:18:17] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.31:60896 2026-02-18T03:18:17.601 INFO:tasks.workunit.client.0.trial031.stdout:{ 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "error_message": "Success", 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "subsystems": [ 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph163465633537", 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 6121, 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 8160, 2026-02-18T03:18:17.602 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: }, 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph23661839356249", 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:17.603 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 6121, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 8160, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: }, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: { 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "enable_ha": true, 2026-02-18T03:18:17.604 INFO:tasks.workunit.client.0.trial031.stdout: "serial_number": "Ceph9703392782333", 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "min_cntlid": 6121, 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "max_cntlid": 8160, 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "namespace_count": 20, 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "subtype": "NVMe", 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "max_namespaces": 512, 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "has_dhchap_key": false, 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "allow_any_host": true, 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "created_without_key": false, 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "network_mask": [] 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: } 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: ], 2026-02-18T03:18:17.605 INFO:tasks.workunit.client.0.trial031.stdout: "status": 0 2026-02-18T03:18:17.606 INFO:tasks.workunit.client.0.trial031.stdout:} 2026-02-18T03:18:17.625 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Subsystem setup done' 2026-02-18T03:18:17.626 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Subsystem setup done 2026-02-18T03:18:17.626 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T03:18:17.627 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T03:18:17.714 INFO:tasks.workunit:Stopping ['nvmeof/setup_subsystem.sh'] on client.0... 2026-02-18T03:18:17.714 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-18T03:18:17.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:18:17 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:18:17] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.31:55874 2026-02-18T03:18:17.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:17 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1643577210' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:17.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:17 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1643577210' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:17.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:17 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1643577210' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:18.029 DEBUG:teuthology.parallel:result is None 2026-02-18T03:18:18.030 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:18:18.055 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:18:18.056 DEBUG:teuthology.orchestra.run.trial031:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:18:18.112 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:18:18.112 INFO:teuthology.run_tasks:Running task workunit... 2026-02-18T03:18:18.123 INFO:tasks.workunit:Pulling workunits from ref adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:18:18.123 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-18T03:18:18.123 DEBUG:teuthology.orchestra.run.trial031:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:18:18.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:18:18.169 INFO:teuthology.orchestra.run.trial031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-18T03:18:18.169 DEBUG:teuthology.orchestra.run.trial031:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:18:18.226 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-18T03:18:18.226 DEBUG:teuthology.orchestra.run.trial031:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-18T03:18:18.284 DEBUG:teuthology.orchestra.run.trial078:> stat -- /home/ubuntu/cephtest/mnt.1 2026-02-18T03:18:18.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:18:18.317 INFO:teuthology.orchestra.run.trial078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.1': No such file or directory 2026-02-18T03:18:18.318 DEBUG:teuthology.orchestra.run.trial078:> mkdir -- /home/ubuntu/cephtest/mnt.1 2026-02-18T03:18:18.373 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.1 2026-02-18T03:18:18.374 DEBUG:teuthology.orchestra.run.trial078:> cd -- /home/ubuntu/cephtest/mnt.1 && mkdir -- client.1 2026-02-18T03:18:18.429 INFO:tasks.workunit:timeout=30m 2026-02-18T03:18:18.430 INFO:tasks.workunit:cleanup=True 2026-02-18T03:18:18.430 DEBUG:teuthology.orchestra.run.trial031:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:18:18.431 DEBUG:teuthology.orchestra.run.trial078:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:18:18.449 INFO:tasks.workunit.client.0.trial031.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-18T03:18:18.495 INFO:tasks.workunit.client.1.trial078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2026-02-18T03:18:18.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:18 trial097 ceph-mon[21799]: pgmap v121: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 5.5 KiB/s wr, 1.25k op/s 2026-02-18T03:18:18.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1543878287' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:18.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/4233417240' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:18 trial119 ceph-mon[24143]: pgmap v121: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 5.5 KiB/s wr, 1.25k op/s 2026-02-18T03:18:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1543878287' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/4233417240' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:18.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:18 trial114 ceph-mon[23907]: pgmap v121: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 MiB/s rd, 5.5 KiB/s wr, 1.25k op/s 2026-02-18T03:18:18.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1543878287' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:18.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/4233417240' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:20.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:20 trial097 ceph-mon[21799]: pgmap v122: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 918 op/s 2026-02-18T03:18:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:20 trial119 ceph-mon[24143]: pgmap v122: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 918 op/s 2026-02-18T03:18:20.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:20 trial114 ceph-mon[23907]: pgmap v122: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 918 op/s 2026-02-18T03:18:21.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:21 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1145843854' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:21.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:21 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1145843854' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:21.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:21 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1145843854' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:22.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:22 trial119 ceph-mon[24143]: pgmap v123: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 953 KiB/s rd, 4.0 KiB/s wr, 903 op/s 2026-02-18T03:18:22.806 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:22 trial097 ceph-mon[21799]: pgmap v123: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 953 KiB/s rd, 4.0 KiB/s wr, 903 op/s 2026-02-18T03:18:22.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:22 trial114 ceph-mon[23907]: pgmap v123: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 953 KiB/s rd, 4.0 KiB/s wr, 903 op/s 2026-02-18T03:18:24.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:24 trial097 ceph-mon[21799]: pgmap v124: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 925 KiB/s rd, 3.8 KiB/s wr, 842 op/s 2026-02-18T03:18:24.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/446868046' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:24 trial119 ceph-mon[24143]: pgmap v124: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 925 KiB/s rd, 3.8 KiB/s wr, 842 op/s 2026-02-18T03:18:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/446868046' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:24.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:24 trial114 ceph-mon[23907]: pgmap v124: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 925 KiB/s rd, 3.8 KiB/s wr, 842 op/s 2026-02-18T03:18:24.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/446868046' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:25.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:25 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3597884469' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:25.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:25 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1634304305' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:25.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:25 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3597884469' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:25.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:25 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1634304305' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:25.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:25 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3597884469' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:25.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:25 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1634304305' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:26.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:26 trial097 ceph-mon[21799]: pgmap v125: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 459 KiB/s rd, 1.7 KiB/s wr, 438 op/s 2026-02-18T03:18:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:26 trial119 ceph-mon[24143]: pgmap v125: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 459 KiB/s rd, 1.7 KiB/s wr, 438 op/s 2026-02-18T03:18:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:26 trial114 ceph-mon[23907]: pgmap v125: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 459 KiB/s rd, 1.7 KiB/s wr, 438 op/s 2026-02-18T03:18:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:28 trial097 ceph-mon[21799]: pgmap v126: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 457 KiB/s rd, 1.7 KiB/s wr, 430 op/s 2026-02-18T03:18:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1388338225' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:28 trial119 ceph-mon[24143]: pgmap v126: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 457 KiB/s rd, 1.7 KiB/s wr, 430 op/s 2026-02-18T03:18:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1388338225' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:28 trial114 ceph-mon[23907]: pgmap v126: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 457 KiB/s rd, 1.7 KiB/s wr, 430 op/s 2026-02-18T03:18:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1388338225' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:30.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:30 trial097 ceph-mon[21799]: pgmap v127: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 251 KiB/s rd, 1023 B/s wr, 162 op/s 2026-02-18T03:18:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:30 trial119 ceph-mon[24143]: pgmap v127: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 251 KiB/s rd, 1023 B/s wr, 162 op/s 2026-02-18T03:18:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:30 trial114 ceph-mon[23907]: pgmap v127: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 251 KiB/s rd, 1023 B/s wr, 162 op/s 2026-02-18T03:18:31.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:31 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3550623087' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:31.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:31 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3550623087' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:31.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:31 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3550623087' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:32.874 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:32 trial114 ceph-mon[23907]: pgmap v128: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 146 KiB/s rd, 341 B/s wr, 123 op/s 2026-02-18T03:18:32.875 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:32 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1411215037' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:32.875 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:32 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1183064644' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:32.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:32 trial097 ceph-mon[21799]: pgmap v128: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 146 KiB/s rd, 341 B/s wr, 123 op/s 2026-02-18T03:18:32.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:32 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1411215037' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:32.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:32 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1183064644' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:32 trial119 ceph-mon[24143]: pgmap v128: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 146 KiB/s rd, 341 B/s wr, 123 op/s 2026-02-18T03:18:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:32 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1411215037' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:32 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1183064644' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:34.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:34 trial097 ceph-mon[21799]: pgmap v129: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 71 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:18:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:34 trial119 ceph-mon[24143]: pgmap v129: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 71 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:18:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:34 trial114 ceph-mon[23907]: pgmap v129: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 71 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:18:35.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:35 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1823468607' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:35.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:35 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1823468607' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:35.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:35 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1823468607' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:36.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:36 trial097 ceph-mon[21799]: pgmap v130: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:18:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:36 trial119 ceph-mon[24143]: pgmap v130: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:18:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:36 trial114 ceph-mon[23907]: pgmap v130: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:18:37.830 INFO:tasks.workunit.client.0.trial031.stderr:Note: switching to 'adc1923395f2bcd6ae89b5d331d278364d1848ed'. 2026-02-18T03:18:37.830 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:18:37.830 INFO:tasks.workunit.client.0.trial031.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-18T03:18:37.830 INFO:tasks.workunit.client.0.trial031.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr:state without impacting any branches by switching back to a branch. 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr: git switch -c 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr:Or undo this operation with: 2026-02-18T03:18:37.831 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:18:37.832 INFO:tasks.workunit.client.0.trial031.stderr: git switch - 2026-02-18T03:18:37.832 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:18:37.832 INFO:tasks.workunit.client.0.trial031.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-18T03:18:37.832 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:18:37.832 INFO:tasks.workunit.client.0.trial031.stderr:HEAD is now at adc1923395f Merge PR #67279 into tentacle 2026-02-18T03:18:37.838 DEBUG:teuthology.orchestra.run.trial031:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-18T03:18:37.900 INFO:tasks.workunit.client.0.trial031.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-18T03:18:37.901 INFO:tasks.workunit.client.0.trial031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-18T03:18:37.901 INFO:tasks.workunit.client.0.trial031.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-18T03:18:37.931 INFO:tasks.workunit.client.0.trial031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-18T03:18:37.960 INFO:tasks.workunit.client.0.trial031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-18T03:18:37.985 INFO:tasks.workunit.client.0.trial031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-18T03:18:37.986 INFO:tasks.workunit.client.0.trial031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-18T03:18:37.986 INFO:tasks.workunit.client.0.trial031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-18T03:18:38.011 INFO:tasks.workunit.client.0.trial031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-18T03:18:38.014 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-18T03:18:38.014 DEBUG:teuthology.orchestra.run.trial031:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-18T03:18:38.074 INFO:tasks.workunit:Running workunits matching nvmeof/basic_tests.sh on client.0... 2026-02-18T03:18:38.076 INFO:tasks.workunit:Running workunit nvmeof/basic_tests.sh... 2026-02-18T03:18:38.076 DEBUG:teuthology.orchestra.run.trial031:workunit test nvmeof/basic_tests.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IOSTAT_INTERVAL=10 RBD_POOL=mypool RUNTIME=600 timeout 30m /home/ubuntu/cephtest/clone.client.0/qa/workunits/nvmeof/basic_tests.sh 2026-02-18T03:18:38.132 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo modprobe nvme-fabrics 2026-02-18T03:18:38.146 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo modprobe nvme-tcp 2026-02-18T03:18:38.159 INFO:tasks.workunit.client.0.trial031.stderr:+ curl -O https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.163 INFO:tasks.workunit.client.0.trial031.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2026-02-18T03:18:38.163 INFO:tasks.workunit.client.0.trial031.stderr: Dload Upload Total Spent Left Speed 2026-02-18T03:18:38.381 INFO:tasks.workunit.client.0.trial031.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1123k 100 1123k 0 0 5151k 0 --:--:-- --:--:-- --:--:-- 5151k 2026-02-18T03:18:38.383 INFO:tasks.workunit.client.0.trial031.stderr:+ curl -O https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.389 INFO:tasks.workunit.client.0.trial031.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2026-02-18T03:18:38.389 INFO:tasks.workunit.client.0.trial031.stderr: Dload Upload Total Spent Left Speed 2026-02-18T03:18:38.439 INFO:tasks.workunit.client.0.trial031.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 110k 100 110k 0 0 2171k 0 --:--:-- --:--:-- --:--:-- 2129k 2026-02-18T03:18:38.439 INFO:tasks.workunit.client.0.trial031.stderr:+ ls -l nvme-cli-2.13-1.el9.x86_64.rpm libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.441 INFO:tasks.workunit.client.0.trial031.stdout:-rw-r--r--. 1 ubuntu ubuntu 113417 Feb 18 03:18 libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.441 INFO:tasks.workunit.client.0.trial031.stdout:-rw-r--r--. 1 ubuntu ubuntu 1149997 Feb 18 03:18 nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.441 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo rpm -qp --qf '%{NAME}-%{VERSION}-%{RELEASE}.%{ARCH}\n' nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.452 INFO:tasks.workunit.client.0.trial031.stdout:nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:18:38.454 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo dnf downgrade ./nvme-cli-2.13-1.el9.x86_64.rpm ./libnvme-1.13-1.el9.x86_64.rpm -y 2026-02-18T03:18:38.472 INFO:tasks.workunit.client.1.trial078.stderr:Note: switching to 'adc1923395f2bcd6ae89b5d331d278364d1848ed'. 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr: 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr:state without impacting any branches by switching back to a branch. 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr: 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr: 2026-02-18T03:18:38.473 INFO:tasks.workunit.client.1.trial078.stderr: git switch -c 2026-02-18T03:18:38.474 INFO:tasks.workunit.client.1.trial078.stderr: 2026-02-18T03:18:38.474 INFO:tasks.workunit.client.1.trial078.stderr:Or undo this operation with: 2026-02-18T03:18:38.474 INFO:tasks.workunit.client.1.trial078.stderr: 2026-02-18T03:18:38.474 INFO:tasks.workunit.client.1.trial078.stderr: git switch - 2026-02-18T03:18:38.474 INFO:tasks.workunit.client.1.trial078.stderr: 2026-02-18T03:18:38.474 INFO:tasks.workunit.client.1.trial078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-18T03:18:38.474 INFO:tasks.workunit.client.1.trial078.stderr: 2026-02-18T03:18:38.474 INFO:tasks.workunit.client.1.trial078.stderr:HEAD is now at adc1923395f Merge PR #67279 into tentacle 2026-02-18T03:18:38.480 DEBUG:teuthology.orchestra.run.trial078:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2026-02-18T03:18:38.539 INFO:tasks.workunit.client.1.trial078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-18T03:18:38.541 INFO:tasks.workunit.client.1.trial078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2026-02-18T03:18:38.541 INFO:tasks.workunit.client.1.trial078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-18T03:18:38.637 INFO:tasks.workunit.client.1.trial078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-18T03:18:38.668 INFO:tasks.workunit.client.1.trial078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-18T03:18:38.693 INFO:tasks.workunit.client.1.trial078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2026-02-18T03:18:38.695 INFO:tasks.workunit.client.1.trial078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2026-02-18T03:18:38.695 INFO:tasks.workunit.client.1.trial078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-18T03:18:38.718 INFO:tasks.workunit.client.1.trial078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2026-02-18T03:18:38.722 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-18T03:18:38.722 DEBUG:teuthology.orchestra.run.trial078:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2026-02-18T03:18:38.746 INFO:tasks.workunit.client.0.trial031.stdout:Last metadata expiration check: 0:05:21 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:18:38.781 INFO:tasks.workunit:Running workunits matching nvmeof/basic_tests.sh on client.1... 2026-02-18T03:18:38.784 INFO:tasks.workunit:Running workunit nvmeof/basic_tests.sh... 2026-02-18T03:18:38.784 DEBUG:teuthology.orchestra.run.trial078:workunit test nvmeof/basic_tests.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 IOSTAT_INTERVAL=10 RBD_POOL=mypool RUNTIME=600 timeout 30m /home/ubuntu/cephtest/clone.client.1/qa/workunits/nvmeof/basic_tests.sh 2026-02-18T03:18:38.838 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo modprobe nvme-fabrics 2026-02-18T03:18:38.852 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo modprobe nvme-tcp 2026-02-18T03:18:38.865 INFO:tasks.workunit.client.1.trial078.stderr:+ curl -O https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.870 INFO:tasks.workunit.client.1.trial078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2026-02-18T03:18:38.870 INFO:tasks.workunit.client.1.trial078.stderr: Dload Upload Total Spent Left Speed 2026-02-18T03:18:38.871 INFO:tasks.workunit.client.0.trial031.stdout:Dependencies resolved. 2026-02-18T03:18:38.871 INFO:tasks.workunit.client.0.trial031.stdout:================================================================================ 2026-02-18T03:18:38.871 INFO:tasks.workunit.client.0.trial031.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout:================================================================================ 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout:Downgrading: 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout: libnvme x86_64 1.13-1.el9 @commandline 111 k 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout: nvme-cli x86_64 2.13-1.el9 @commandline 1.1 M 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout:Transaction Summary 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout:================================================================================ 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout:Downgrade 2 Packages 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout:Total size: 1.2 M 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout:Downloading Packages: 2026-02-18T03:18:38.872 INFO:tasks.workunit.client.0.trial031.stdout:Running transaction check 2026-02-18T03:18:38.877 INFO:tasks.workunit.client.0.trial031.stdout:Transaction check succeeded. 2026-02-18T03:18:38.877 INFO:tasks.workunit.client.0.trial031.stdout:Running transaction test 2026-02-18T03:18:38.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:38 trial097 ceph-mon[21799]: pgmap v131: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:18:38.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:38 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/654214094' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:38.918 INFO:tasks.workunit.client.1.trial078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1123k 100 1123k 0 0 22.3M 0 --:--:-- --:--:-- --:--:-- 22.3M 2026-02-18T03:18:38.919 INFO:tasks.workunit.client.1.trial078.stderr:+ curl -O https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.921 INFO:tasks.workunit.client.0.trial031.stdout:Transaction test succeeded. 2026-02-18T03:18:38.921 INFO:tasks.workunit.client.0.trial031.stdout:Running transaction 2026-02-18T03:18:38.923 INFO:tasks.workunit.client.1.trial078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2026-02-18T03:18:38.924 INFO:tasks.workunit.client.1.trial078.stderr: Dload Upload Total Spent Left Speed 2026-02-18T03:18:38.958 INFO:tasks.workunit.client.1.trial078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 110k 100 110k 0 0 3164k 0 --:--:-- --:--:-- --:--:-- 3164k 2026-02-18T03:18:38.959 INFO:tasks.workunit.client.1.trial078.stderr:+ ls -l nvme-cli-2.13-1.el9.x86_64.rpm libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.960 INFO:tasks.workunit.client.1.trial078.stdout:-rw-r--r--. 1 ubuntu ubuntu 113417 Feb 18 03:18 libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.960 INFO:tasks.workunit.client.1.trial078.stdout:-rw-r--r--. 1 ubuntu ubuntu 1149997 Feb 18 03:18 nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.960 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo rpm -qp --qf '%{NAME}-%{VERSION}-%{RELEASE}.%{ARCH}\n' nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:18:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:38 trial119 ceph-mon[24143]: pgmap v131: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:18:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:38 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/654214094' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:38.971 INFO:tasks.workunit.client.1.trial078.stdout:nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:18:38.973 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo dnf downgrade ./nvme-cli-2.13-1.el9.x86_64.rpm ./libnvme-1.13-1.el9.x86_64.rpm -y 2026-02-18T03:18:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:38 trial114 ceph-mon[23907]: pgmap v131: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:18:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:38 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/654214094' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:38.983 INFO:tasks.workunit.client.0.trial031.stdout: Preparing : 1/1 2026-02-18T03:18:39.102 INFO:tasks.workunit.client.0.trial031.stdout: Downgrading : libnvme-1.13-1.el9.x86_64 1/4 2026-02-18T03:18:39.105 INFO:tasks.workunit.client.0.trial031.stdout: Downgrading : nvme-cli-2.13-1.el9.x86_64 2/4 2026-02-18T03:18:39.264 INFO:tasks.workunit.client.1.trial078.stdout:Last metadata expiration check: 0:05:29 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:18:39.304 INFO:tasks.workunit.client.0.trial031.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 2/4 2026-02-18T03:18:39.309 INFO:tasks.workunit.client.0.trial031.stdout: Cleanup : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:18:39.332 INFO:tasks.workunit.client.0.trial031.stdout: Cleanup : libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:18:39.389 INFO:tasks.workunit.client.1.trial078.stdout:Dependencies resolved. 2026-02-18T03:18:39.389 INFO:tasks.workunit.client.1.trial078.stdout:================================================================================ 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout:================================================================================ 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout:Downgrading: 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout: libnvme x86_64 1.13-1.el9 @commandline 111 k 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout: nvme-cli x86_64 2.13-1.el9 @commandline 1.1 M 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout:Transaction Summary 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout:================================================================================ 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout:Downgrade 2 Packages 2026-02-18T03:18:39.390 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:39.391 INFO:tasks.workunit.client.1.trial078.stdout:Total size: 1.2 M 2026-02-18T03:18:39.391 INFO:tasks.workunit.client.1.trial078.stdout:Downloading Packages: 2026-02-18T03:18:39.391 INFO:tasks.workunit.client.1.trial078.stdout:Running transaction check 2026-02-18T03:18:39.395 INFO:tasks.workunit.client.1.trial078.stdout:Transaction check succeeded. 2026-02-18T03:18:39.395 INFO:tasks.workunit.client.1.trial078.stdout:Running transaction test 2026-02-18T03:18:39.437 INFO:tasks.workunit.client.1.trial078.stdout:Transaction test succeeded. 2026-02-18T03:18:39.437 INFO:tasks.workunit.client.1.trial078.stdout:Running transaction 2026-02-18T03:18:39.499 INFO:tasks.workunit.client.1.trial078.stdout: Preparing : 1/1 2026-02-18T03:18:39.615 INFO:tasks.workunit.client.1.trial078.stdout: Downgrading : libnvme-1.13-1.el9.x86_64 1/4 2026-02-18T03:18:39.618 INFO:tasks.workunit.client.1.trial078.stdout: Downgrading : nvme-cli-2.13-1.el9.x86_64 2/4 2026-02-18T03:18:39.750 INFO:tasks.workunit.client.0.trial031.stdout: Running scriptlet: libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:18:39.750 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 1/4 2026-02-18T03:18:39.750 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:18:39.750 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : libnvme-1.13-1.el9.x86_64 3/4 2026-02-18T03:18:39.806 INFO:tasks.workunit.client.1.trial078.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 2/4 2026-02-18T03:18:39.807 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:18:39.807 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:39.807 INFO:tasks.workunit.client.0.trial031.stdout:Downgraded: 2026-02-18T03:18:39.807 INFO:tasks.workunit.client.0.trial031.stdout: libnvme-1.13-1.el9.x86_64 nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:18:39.807 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:39.808 INFO:tasks.workunit.client.0.trial031.stdout:Complete! 2026-02-18T03:18:39.811 INFO:tasks.workunit.client.1.trial078.stdout: Cleanup : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:18:39.834 INFO:tasks.workunit.client.1.trial078.stdout: Cleanup : libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:18:39.835 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo lsmod 2026-02-18T03:18:39.835 INFO:tasks.workunit.client.0.trial031.stderr:+ grep nvme 2026-02-18T03:18:39.870 INFO:tasks.workunit.client.0.trial031.stdout:nvme_tcp 102400 0 2026-02-18T03:18:39.870 INFO:tasks.workunit.client.0.trial031.stdout:nvme_fabrics 49152 1 nvme_tcp 2026-02-18T03:18:39.870 INFO:tasks.workunit.client.0.trial031.stdout:nvme 65536 7 2026-02-18T03:18:39.870 INFO:tasks.workunit.client.0.trial031.stdout:nvme_core 274432 10 nvme_tcp,nvme,nvme_fabrics 2026-02-18T03:18:39.870 INFO:tasks.workunit.client.0.trial031.stdout:nvme_keyring 20480 3 nvme_tcp,nvme_core,nvme_fabrics 2026-02-18T03:18:39.870 INFO:tasks.workunit.client.0.trial031.stdout:nvme_auth 36864 1 nvme_core 2026-02-18T03:18:39.870 INFO:tasks.workunit.client.0.trial031.stderr:+ nvme version 2026-02-18T03:18:39.871 INFO:tasks.workunit.client.0.trial031.stdout:nvme version 2.13 (git 2.13) 2026-02-18T03:18:39.871 INFO:tasks.workunit.client.0.trial031.stdout:libnvme version 1.13 (git 1.13) 2026-02-18T03:18:39.872 INFO:tasks.workunit.client.0.trial031.stderr:+ source /etc/ceph/nvmeof.env 2026-02-18T03:18:39.872 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=10.20.193.97,10.20.193.114,10.20.193.119,10.20.193.194 2026-02-18T03:18:39.872 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_GATEWAY_NAMES=trial097,trial114,trial119,trial194 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=10.20.193.97 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_CLI_IMAGE=quay.io/ceph/nvmeof-cli:devel 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=3 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_NAMESPACES_COUNT=20 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_PORT=4420 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:++ NVMEOF_SRPORT=5500 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:+ SPDK_CONTROLLER='Ceph bdev Controller' 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:+ DISCOVERY_PORT=8009 2026-02-18T03:18:39.873 INFO:tasks.workunit.client.0.trial031.stderr:+ test_run disconnect_all 2026-02-18T03:18:39.874 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Running test: disconnect_all 2026-02-18T03:18:39.874 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2026-02-18T03:18:39.874 INFO:tasks.workunit.client.0.trial031.stderr:+ disconnect_all 2026-02-18T03:18:39.874 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo nvme disconnect-all 2026-02-18T03:18:39.882 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme list 2026-02-18T03:18:39.893 INFO:tasks.workunit.client.0.trial031.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:18:39.893 INFO:tasks.workunit.client.0.trial031.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:18:39.893 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme0n1 /dev/ng0n1 25174FCD6BC1 Micron_7450_MTFDKBA960TFR 0x1 200.05 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:18:39.893 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme1n1 /dev/ng1n1 112510AB5195 MTFDKCC1T9TGP-1BK1JABYY 0x1 143.91 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:39.893 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme2n1 /dev/ng2n1 112510AB516F MTFDKCC1T9TGP-1BK1JABYY 0x1 218.60 GB / 1.92 TB 512 B + 0 B E3MQ000 ' 2026-02-18T03:18:39.893 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:18:39.893 INFO:tasks.workunit.client.0.trial031.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:18:39.893 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme0n1 /dev/ng0n1 25174FCD6BC1 Micron_7450_MTFDKBA960TFR 0x1 200.05 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:18:39.894 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme1n1 /dev/ng1n1 112510AB5195 MTFDKCC1T9TGP-1BK1JABYY 0x1 143.91 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:39.894 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme2n1 /dev/ng2n1 112510AB516F MTFDKCC1T9TGP-1BK1JABYY 0x1 218.60 GB / 1.92 TB 512 B + 0 B E3MQ000 ' 2026-02-18T03:18:39.894 INFO:tasks.workunit.client.0.trial031.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:18:39.894 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:39.895 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] disconnect_all test passed! 2026-02-18T03:18:39.895 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2026-02-18T03:18:39.895 INFO:tasks.workunit.client.0.trial031.stderr:+ test_run discovery 2026-02-18T03:18:39.895 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Running test: discovery 2026-02-18T03:18:39.896 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Running test: discovery' 2026-02-18T03:18:39.896 INFO:tasks.workunit.client.0.trial031.stderr:+ discovery 2026-02-18T03:18:39.896 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme discover -t tcp -a 10.20.193.97 -s 8009 2026-02-18T03:18:39.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:39 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2982890216' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:39.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:39 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3327277686' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:39.964 INFO:tasks.workunit.client.0.trial031.stderr:+ output=' 2026-02-18T03:18:39.964 INFO:tasks.workunit.client.0.trial031.stderr:Discovery Log Number of Records 12, Generation counter 1 2026-02-18T03:18:39.964 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 0====== 2026-02-18T03:18:39.964 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.964 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.964 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:portid: 0 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.97 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 1====== 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.965 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:portid: 1 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.114 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 2====== 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.966 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:portid: 2 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.119 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 3====== 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:portid: 3 2026-02-18T03:18:39.967 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.194 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 4====== 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:portid: 4 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.968 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.97 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 5====== 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:portid: 5 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.114 2026-02-18T03:18:39.969 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 6====== 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:portid: 6 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.119 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.970 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 7====== 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:portid: 7 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.194 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 8====== 2026-02-18T03:18:39.971 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:portid: 8 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.97 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 9====== 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.972 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:portid: 9 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.114 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 10====== 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.973 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:portid: 10 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.119 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 11====== 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:portid: 11 2026-02-18T03:18:39.974 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.194 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none' 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:+ expected_discovery_stdout='subtype: nvme subsystem' 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:+ echo ' 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:Discovery Log Number of Records 12, Generation counter 1 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 0====== 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.975 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:portid: 0 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.97 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 1====== 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:portid: 1 2026-02-18T03:18:39.976 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.114 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 2====== 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:portid: 2 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.977 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.119 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 3====== 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:portid: 3 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.194 2026-02-18T03:18:39.978 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 4====== 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:portid: 4 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.97 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.979 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 5====== 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:portid: 5 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.114 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 6====== 2026-02-18T03:18:39.980 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:portid: 6 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.119 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 7====== 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.981 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:portid: 7 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.194 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 8====== 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.982 INFO:tasks.workunit.client.0.trial031.stderr:portid: 8 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.97 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 9====== 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:portid: 9 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.983 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.114 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 10====== 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:portid: 10 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.119 2026-02-18T03:18:39.984 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:=====Discovery Log Entry 11====== 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:trtype: tcp 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:adrfam: ipv4 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:subtype: nvme subsystem 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:treq: not required 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:portid: 11 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:trsvcid: 4420 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:traddr: 10.20.193.194 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:eflags: none 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:sectype: none' 2026-02-18T03:18:39.985 INFO:tasks.workunit.client.0.trial031.stderr:+ grep -q 'subtype: nvme subsystem' 2026-02-18T03:18:39.986 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:39.986 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] discovery test passed! 2026-02-18T03:18:39.987 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] discovery test passed!' 2026-02-18T03:18:39.987 INFO:tasks.workunit.client.0.trial031.stderr:+ test_run connect 2026-02-18T03:18:39.987 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Running test: connect' 2026-02-18T03:18:39.987 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Running test: connect 2026-02-18T03:18:39.987 INFO:tasks.workunit.client.0.trial031.stderr:+ connect 2026-02-18T03:18:39.988 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo nvme connect -t tcp --traddr 10.20.193.97 -s 4420 -n nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:39.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:39 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2982890216' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:39.988 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:39 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3327277686' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:39.989 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:39 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2982890216' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:39.989 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:39 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3327277686' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.056 INFO:tasks.workunit.client.0.trial031.stdout:connecting to device: nvme3 2026-02-18T03:18:40.059 INFO:tasks.workunit.client.0.trial031.stderr:+ sleep 5 2026-02-18T03:18:40.262 INFO:tasks.workunit.client.1.trial078.stdout: Running scriptlet: libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:18:40.262 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 1/4 2026-02-18T03:18:40.263 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:18:40.263 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : libnvme-1.13-1.el9.x86_64 3/4 2026-02-18T03:18:40.319 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:18:40.319 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:40.319 INFO:tasks.workunit.client.1.trial078.stdout:Downgraded: 2026-02-18T03:18:40.319 INFO:tasks.workunit.client.1.trial078.stdout: libnvme-1.13-1.el9.x86_64 nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:18:40.319 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:40.319 INFO:tasks.workunit.client.1.trial078.stdout:Complete! 2026-02-18T03:18:40.346 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo lsmod 2026-02-18T03:18:40.346 INFO:tasks.workunit.client.1.trial078.stderr:+ grep nvme 2026-02-18T03:18:40.369 INFO:tasks.workunit.client.1.trial078.stdout:nvme_tcp 102400 0 2026-02-18T03:18:40.369 INFO:tasks.workunit.client.1.trial078.stdout:nvme_fabrics 49152 1 nvme_tcp 2026-02-18T03:18:40.369 INFO:tasks.workunit.client.1.trial078.stdout:nvme 65536 7 2026-02-18T03:18:40.370 INFO:tasks.workunit.client.1.trial078.stdout:nvme_core 274432 10 nvme_tcp,nvme,nvme_fabrics 2026-02-18T03:18:40.370 INFO:tasks.workunit.client.1.trial078.stdout:nvme_keyring 20480 3 nvme_tcp,nvme_core,nvme_fabrics 2026-02-18T03:18:40.370 INFO:tasks.workunit.client.1.trial078.stdout:nvme_auth 36864 1 nvme_core 2026-02-18T03:18:40.370 INFO:tasks.workunit.client.1.trial078.stderr:+ nvme version 2026-02-18T03:18:40.370 INFO:tasks.workunit.client.1.trial078.stdout:nvme version 2.13 (git 2.13) 2026-02-18T03:18:40.371 INFO:tasks.workunit.client.1.trial078.stdout:libnvme version 1.13 (git 1.13) 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:+ source /etc/ceph/nvmeof.env 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=10.20.193.97,10.20.193.114,10.20.193.119,10.20.193.194 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_GATEWAY_NAMES=trial097,trial114,trial119,trial194 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=10.20.193.97 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_CLI_IMAGE=quay.io/ceph/nvmeof-cli:devel 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=3 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_NAMESPACES_COUNT=20 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_PORT=4420 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:++ NVMEOF_SRPORT=5500 2026-02-18T03:18:40.372 INFO:tasks.workunit.client.1.trial078.stderr:+ SPDK_CONTROLLER='Ceph bdev Controller' 2026-02-18T03:18:40.373 INFO:tasks.workunit.client.1.trial078.stderr:+ DISCOVERY_PORT=8009 2026-02-18T03:18:40.373 INFO:tasks.workunit.client.1.trial078.stderr:+ test_run disconnect_all 2026-02-18T03:18:40.373 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] Running test: disconnect_all 2026-02-18T03:18:40.373 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2026-02-18T03:18:40.373 INFO:tasks.workunit.client.1.trial078.stderr:+ disconnect_all 2026-02-18T03:18:40.373 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo nvme disconnect-all 2026-02-18T03:18:40.382 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme list 2026-02-18T03:18:40.393 INFO:tasks.workunit.client.1.trial078.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:18:40.393 INFO:tasks.workunit.client.1.trial078.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:18:40.393 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme0n1 /dev/ng0n1 012510B00120 MTFDKCC1T9TGP-1BK1JABYY 0x1 139.78 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:40.393 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme1n1 /dev/ng1n1 012510B000E6 MTFDKCC1T9TGP-1BK1JABYY 0x1 139.67 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:40.393 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme2n1 /dev/ng2n1 25174FCD87E6 Micron_7450_MTFDKBA960TFR 0x1 231.65 GB / 960.20 GB 512 B + 0 B E2MU200 ' 2026-02-18T03:18:40.393 INFO:tasks.workunit.client.1.trial078.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:18:40.393 INFO:tasks.workunit.client.1.trial078.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:18:40.394 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme0n1 /dev/ng0n1 012510B00120 MTFDKCC1T9TGP-1BK1JABYY 0x1 139.78 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:40.394 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme1n1 /dev/ng1n1 012510B000E6 MTFDKCC1T9TGP-1BK1JABYY 0x1 139.67 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:40.394 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme2n1 /dev/ng2n1 25174FCD87E6 Micron_7450_MTFDKBA960TFR 0x1 231.65 GB / 960.20 GB 512 B + 0 B E2MU200 ' 2026-02-18T03:18:40.394 INFO:tasks.workunit.client.1.trial078.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:18:40.394 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:40.395 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] disconnect_all test passed! 2026-02-18T03:18:40.395 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2026-02-18T03:18:40.395 INFO:tasks.workunit.client.1.trial078.stderr:+ test_run discovery 2026-02-18T03:18:40.395 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] Running test: discovery 2026-02-18T03:18:40.396 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] Running test: discovery' 2026-02-18T03:18:40.396 INFO:tasks.workunit.client.1.trial078.stderr:+ discovery 2026-02-18T03:18:40.396 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme discover -t tcp -a 10.20.193.97 -s 8009 2026-02-18T03:18:40.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:39] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:39] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:39] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:39] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:39 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:39] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.457 INFO:tasks.workunit.client.1.trial078.stderr:+ output=' 2026-02-18T03:18:40.457 INFO:tasks.workunit.client.1.trial078.stderr:Discovery Log Number of Records 12, Generation counter 2 2026-02-18T03:18:40.457 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 0====== 2026-02-18T03:18:40.457 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.457 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:portid: 0 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.97 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 1====== 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.458 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:portid: 1 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.114 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 2====== 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.459 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:portid: 2 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.119 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 3====== 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:portid: 3 2026-02-18T03:18:40.460 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.194 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 4====== 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:portid: 4 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.461 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.97 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 5====== 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:portid: 5 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:40.462 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.114 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 6====== 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:portid: 6 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.119 2026-02-18T03:18:40.463 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 7====== 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:portid: 7 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.194 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.464 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 8====== 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:portid: 8 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.97 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 9====== 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.465 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:portid: 9 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.114 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 10====== 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.466 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:portid: 10 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.119 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 11====== 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.467 INFO:tasks.workunit.client.1.trial078.stderr:portid: 11 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.194 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none' 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:+ expected_discovery_stdout='subtype: nvme subsystem' 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:+ echo ' 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:Discovery Log Number of Records 12, Generation counter 2 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 0====== 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.468 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:portid: 0 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.97 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 1====== 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:portid: 1 2026-02-18T03:18:40.469 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.114 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 2====== 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:portid: 2 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.470 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.119 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 3====== 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:portid: 3 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.194 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.471 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 4====== 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:portid: 4 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.97 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 5====== 2026-02-18T03:18:40.472 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:portid: 5 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.114 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 6====== 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.473 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:portid: 6 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.119 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 7====== 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.474 INFO:tasks.workunit.client.1.trial078.stderr:portid: 7 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.194 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 8====== 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:portid: 8 2026-02-18T03:18:40.475 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.97 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 9====== 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:portid: 9 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.114 2026-02-18T03:18:40.476 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 10====== 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:portid: 10 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.119 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none 2026-02-18T03:18:40.477 INFO:tasks.workunit.client.1.trial078.stderr:=====Discovery Log Entry 11====== 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:trtype: tcp 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:adrfam: ipv4 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:subtype: nvme subsystem 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:treq: not required 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:portid: 11 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:trsvcid: 4420 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:traddr: 10.20.193.194 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:eflags: none 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:+ grep -q 'subtype: nvme subsystem' 2026-02-18T03:18:40.478 INFO:tasks.workunit.client.1.trial078.stderr:sectype: none' 2026-02-18T03:18:40.479 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:40.479 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] discovery test passed!' 2026-02-18T03:18:40.480 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] discovery test passed! 2026-02-18T03:18:40.480 INFO:tasks.workunit.client.1.trial078.stderr:+ test_run connect 2026-02-18T03:18:40.480 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] Running test: connect 2026-02-18T03:18:40.481 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] Running test: connect' 2026-02-18T03:18:40.481 INFO:tasks.workunit.client.1.trial078.stderr:+ connect 2026-02-18T03:18:40.481 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo nvme connect -t tcp --traddr 10.20.193.97 -s 4420 -n nqn.2016-06.io.spdk:cnode1 2026-02-18T03:18:40.550 INFO:tasks.workunit.client.1.trial078.stdout:connecting to device: nvme3 2026-02-18T03:18:40.557 INFO:tasks.workunit.client.1.trial078.stderr:+ sleep 5 2026-02-18T03:18:40.864 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: pgmap v132: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 71 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:18:40.864 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/261629671' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/75111583' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1683068211' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3920538110' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3148134260' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/700727741' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/986011935' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3882208167' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1931103436' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2699026974' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:40] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:40] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:40] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:40] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:40] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: pgmap v132: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 71 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/261629671' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/75111583' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1683068211' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3920538110' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3148134260' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/700727741' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/986011935' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3882208167' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1931103436' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.907 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2699026974' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: pgmap v132: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 71 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:18:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/261629671' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/75111583' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1683068211' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3920538110' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3148134260' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/700727741' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/986011935' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3882208167' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1931103436' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2699026974' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:42.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:42 trial097 ceph-mon[21799]: pgmap v133: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 85 B/s wr, 8 op/s 2026-02-18T03:18:42.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:42 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2245447523' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:42 trial119 ceph-mon[24143]: pgmap v133: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 85 B/s wr, 8 op/s 2026-02-18T03:18:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:42 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2245447523' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:42 trial114 ceph-mon[23907]: pgmap v133: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 47 KiB/s rd, 85 B/s wr, 8 op/s 2026-02-18T03:18:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:42 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2245447523' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:44 trial097 ceph-mon[21799]: pgmap v134: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 100 KiB/s rd, 85 B/s wr, 17 op/s 2026-02-18T03:18:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:44 trial119 ceph-mon[24143]: pgmap v134: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 100 KiB/s rd, 85 B/s wr, 17 op/s 2026-02-18T03:18:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:44 trial114 ceph-mon[23907]: pgmap v134: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 100 KiB/s rd, 85 B/s wr, 17 op/s 2026-02-18T03:18:45.060 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:18:45.076 INFO:tasks.workunit.client.0.trial031.stderr:+ output='{ 2026-02-18T03:18:45.076 INFO:tasks.workunit.client.0.trial031.stderr: "Devices":[ 2026-02-18T03:18:45.076 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.076 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":1, 2026-02-18T03:18:45.076 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme0n1", 2026-02-18T03:18:45.076 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng0n1", 2026-02-18T03:18:45.076 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"E2MU200", 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"25174FCD6BC1", 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":200045314048, 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":1875385008, 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":960197124096, 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":1, 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme1n1", 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng1n1", 2026-02-18T03:18:45.077 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"E3MQ000", 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"112510AB5195", 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":143912361984, 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":3750748848, 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":1, 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme2n1", 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng2n1", 2026-02-18T03:18:45.078 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"E3MQ000", 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"112510AB516F", 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":218603204608, 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":3750748848, 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":12, 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n12", 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n12", 2026-02-18T03:18:45.079 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":16, 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n16", 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n16", 2026-02-18T03:18:45.080 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":20, 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n20", 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n20", 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.081 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":4, 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n4", 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n4", 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.082 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":8, 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n8", 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n8", 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.083 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr:}' 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '{ 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: "Devices":[ 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":1, 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme0n1", 2026-02-18T03:18:45.084 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng0n1", 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"E2MU200", 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"25174FCD6BC1", 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":200045314048, 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":1875385008, 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":960197124096, 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":1, 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme1n1", 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng1n1", 2026-02-18T03:18:45.085 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"E3MQ000", 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"112510AB5195", 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":143912361984, 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":3750748848, 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":1, 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme2n1", 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng2n1", 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"E3MQ000", 2026-02-18T03:18:45.086 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"112510AB516F", 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":218603204608, 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":3750748848, 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":12, 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n12", 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n12", 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.087 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":16, 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n16", 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n16", 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.088 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":20, 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n20", 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n20", 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.089 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":4, 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n4", 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n4", 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.090 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "NameSpace":8, 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "DevicePath":"/dev/nvme3n8", 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "GenericPath":"/dev/ng3n8", 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.091 INFO:tasks.workunit.client.0.trial031.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.092 INFO:tasks.workunit.client.0.trial031.stderr: "SectorSize":512 2026-02-18T03:18:45.092 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.092 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.092 INFO:tasks.workunit.client.0.trial031.stderr:}' 2026-02-18T03:18:45.092 INFO:tasks.workunit.client.0.trial031.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:18:45.092 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:45.093 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] connect test passed! 2026-02-18T03:18:45.093 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] connect test passed!' 2026-02-18T03:18:45.093 INFO:tasks.workunit.client.0.trial031.stderr:+ test_run list_subsys 1 2026-02-18T03:18:45.094 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:18:45.094 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:18:45.095 INFO:tasks.workunit.client.0.trial031.stderr:+ list_subsys 1 2026-02-18T03:18:45.095 INFO:tasks.workunit.client.0.trial031.stderr:+ expected_count=1 2026-02-18T03:18:45.095 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr:+ output='[ 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: "Subsystems":[ 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys0", 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD6BC1", 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.096 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme0", 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:02:00.0", 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys1", 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB5195", 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme1", 2026-02-18T03:18:45.097 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:03:00.0", 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys2", 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB516F", 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme2", 2026-02-18T03:18:45.098 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:04:00.0", 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys3", 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme3", 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:45.099 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr:]' 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD6BC1",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB5195",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB516F",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys3",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"Paths":[' '{' '"Name":"nvme3",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr:++ grep -o '"tcp"' 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr:++ wc -l 2026-02-18T03:18:45.100 INFO:tasks.workunit.client.0.trial031.stderr:+ multipath=1 2026-02-18T03:18:45.101 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 1 -ne 1 ']' 2026-02-18T03:18:45.101 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:45.101 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:18:45.101 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:18:45.101 INFO:tasks.workunit.client.0.trial031.stderr:+ test_run disconnect_all 2026-02-18T03:18:45.102 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Running test: disconnect_all 2026-02-18T03:18:45.102 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2026-02-18T03:18:45.102 INFO:tasks.workunit.client.0.trial031.stderr:+ disconnect_all 2026-02-18T03:18:45.103 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo nvme disconnect-all 2026-02-18T03:18:45.444 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme list 2026-02-18T03:18:45.454 INFO:tasks.workunit.client.0.trial031.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:18:45.454 INFO:tasks.workunit.client.0.trial031.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme0n1 /dev/ng0n1 25174FCD6BC1 Micron_7450_MTFDKBA960TFR 0x1 200.05 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme1n1 /dev/ng1n1 112510AB5195 MTFDKCC1T9TGP-1BK1JABYY 0x1 143.91 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme2n1 /dev/ng2n1 112510AB516F MTFDKCC1T9TGP-1BK1JABYY 0x1 218.60 GB / 1.92 TB 512 B + 0 B E3MQ000 ' 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme0n1 /dev/ng0n1 25174FCD6BC1 Micron_7450_MTFDKBA960TFR 0x1 200.05 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme1n1 /dev/ng1n1 112510AB5195 MTFDKCC1T9TGP-1BK1JABYY 0x1 143.91 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme2n1 /dev/ng2n1 112510AB516F MTFDKCC1T9TGP-1BK1JABYY 0x1 218.60 GB / 1.92 TB 512 B + 0 B E3MQ000 ' 2026-02-18T03:18:45.455 INFO:tasks.workunit.client.0.trial031.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:18:45.456 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:45.456 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2026-02-18T03:18:45.456 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] disconnect_all test passed! 2026-02-18T03:18:45.457 INFO:tasks.workunit.client.0.trial031.stderr:+ test_run list_subsys 0 2026-02-18T03:18:45.457 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:18:45.457 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:18:45.458 INFO:tasks.workunit.client.0.trial031.stderr:+ list_subsys 0 2026-02-18T03:18:45.458 INFO:tasks.workunit.client.0.trial031.stderr:+ expected_count=0 2026-02-18T03:18:45.458 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:18:45.465 INFO:tasks.workunit.client.0.trial031.stderr:+ output='[ 2026-02-18T03:18:45.465 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.465 INFO:tasks.workunit.client.0.trial031.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:45.465 INFO:tasks.workunit.client.0.trial031.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:45.465 INFO:tasks.workunit.client.0.trial031.stderr: "Subsystems":[ 2026-02-18T03:18:45.465 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys0", 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD6BC1", 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme0", 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:02:00.0", 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.466 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys1", 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB5195", 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme1", 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:03:00.0", 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.467 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys2", 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB516F", 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme2", 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:04:00.0", 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:45.468 INFO:tasks.workunit.client.0.trial031.stderr:]' 2026-02-18T03:18:45.470 INFO:tasks.workunit.client.0.trial031.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD6BC1",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB5195",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB516F",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:18:45.470 INFO:tasks.workunit.client.0.trial031.stderr:++ grep -o '"tcp"' 2026-02-18T03:18:45.470 INFO:tasks.workunit.client.0.trial031.stderr:++ wc -l 2026-02-18T03:18:45.470 INFO:tasks.workunit.client.0.trial031.stderr:+ multipath=0 2026-02-18T03:18:45.470 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -ne 0 ']' 2026-02-18T03:18:45.470 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:45.470 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:18:45.471 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:18:45.471 INFO:tasks.workunit.client.0.trial031.stderr:+ devices_count=60 2026-02-18T03:18:45.471 INFO:tasks.workunit.client.0.trial031.stderr:+ test_run connect_all 60 2026-02-18T03:18:45.471 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Running test: connect_all 2026-02-18T03:18:45.472 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Running test: connect_all' 2026-02-18T03:18:45.472 INFO:tasks.workunit.client.0.trial031.stderr:+ connect_all 60 2026-02-18T03:18:45.472 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo nvme connect-all --traddr=10.20.193.97 --transport=tcp -l 3600 2026-02-18T03:18:45.558 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:18:45.574 INFO:tasks.workunit.client.1.trial078.stderr:+ output='{ 2026-02-18T03:18:45.574 INFO:tasks.workunit.client.1.trial078.stderr: "Devices":[ 2026-02-18T03:18:45.574 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.574 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":1, 2026-02-18T03:18:45.574 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme0n1", 2026-02-18T03:18:45.574 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng0n1", 2026-02-18T03:18:45.574 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"E3MQ000", 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"012510B00120", 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":139775188992, 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":3750748848, 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":1, 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme1n1", 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng1n1", 2026-02-18T03:18:45.575 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"E3MQ000", 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"012510B000E6", 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":139672309760, 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":3750748848, 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":1, 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme2n1", 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng2n1", 2026-02-18T03:18:45.576 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"E2MU200", 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"25174FCD87E6", 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":231646625792, 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":1875385008, 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":960197124096, 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":12, 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n12", 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n12", 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.577 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":16, 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n16", 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n16", 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.578 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":20, 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n20", 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n20", 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.579 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":4, 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n4", 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n4", 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.580 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":8, 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n8", 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n8", 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.581 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr:}' 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '{ 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: "Devices":[ 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":1, 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme0n1", 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng0n1", 2026-02-18T03:18:45.582 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"E3MQ000", 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"012510B00120", 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":139775188992, 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":3750748848, 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":1, 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme1n1", 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng1n1", 2026-02-18T03:18:45.583 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"E3MQ000", 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"012510B000E6", 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":139672309760, 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":3750748848, 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":1, 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme2n1", 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng2n1", 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"E2MU200", 2026-02-18T03:18:45.584 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"25174FCD87E6", 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":231646625792, 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":1875385008, 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":960197124096, 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":12, 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n12", 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n12", 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.585 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":16, 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n16", 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n16", 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.586 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":20, 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n20", 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n20", 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.587 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":4, 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n4", 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n4", 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.588 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "NameSpace":8, 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "DevicePath":"/dev/nvme3n8", 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "GenericPath":"/dev/ng3n8", 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "Firmware":"25.09", 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "SerialNumber":"Ceph163465633537", 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "UsedBytes":8589934592, 2026-02-18T03:18:45.589 INFO:tasks.workunit.client.1.trial078.stderr: "MaximumLBA":16777216, 2026-02-18T03:18:45.590 INFO:tasks.workunit.client.1.trial078.stderr: "PhysicalSize":8589934592, 2026-02-18T03:18:45.590 INFO:tasks.workunit.client.1.trial078.stderr: "SectorSize":512 2026-02-18T03:18:45.590 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:45.590 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:45.590 INFO:tasks.workunit.client.1.trial078.stderr:}' 2026-02-18T03:18:45.590 INFO:tasks.workunit.client.1.trial078.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:18:45.591 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:45.591 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] connect test passed! 2026-02-18T03:18:45.591 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] connect test passed!' 2026-02-18T03:18:45.592 INFO:tasks.workunit.client.1.trial078.stderr:+ test_run list_subsys 1 2026-02-18T03:18:45.592 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:18:45.593 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:18:45.593 INFO:tasks.workunit.client.1.trial078.stderr:+ list_subsys 1 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr:+ expected_count=1 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr:+ output='[ 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr: "Subsystems":[ 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys0", 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00120", 2026-02-18T03:18:45.594 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme0", 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:04:00.0", 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys1", 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B000E6", 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:45.595 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme1", 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:03:00.0", 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys2", 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD87E6", 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.596 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme2", 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:02:00.0", 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys3", 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme3", 2026-02-18T03:18:45.597 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr:]' 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00120",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B000E6",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD87E6",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys3",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"Paths":[' '{' '"Name":"nvme3",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr:++ grep -o '"tcp"' 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr:++ wc -l 2026-02-18T03:18:45.598 INFO:tasks.workunit.client.1.trial078.stderr:+ multipath=1 2026-02-18T03:18:45.599 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 1 -ne 1 ']' 2026-02-18T03:18:45.599 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:45.599 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:18:45.599 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:18:45.599 INFO:tasks.workunit.client.1.trial078.stderr:+ test_run disconnect_all 2026-02-18T03:18:45.600 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] Running test: disconnect_all 2026-02-18T03:18:45.600 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2026-02-18T03:18:45.600 INFO:tasks.workunit.client.1.trial078.stderr:+ disconnect_all 2026-02-18T03:18:45.600 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo nvme disconnect-all 2026-02-18T03:18:45.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3285811966' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2145585040' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2934603670' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3872399823' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/974290455' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:45] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:45.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:45] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:45.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:45] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:45.907 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:45 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:45] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3285811966' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2145585040' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2934603670' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3872399823' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/974290455' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3285811966' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2145585040' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2934603670' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3872399823' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/974290455' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:45.977 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme list 2026-02-18T03:18:45.987 INFO:tasks.workunit.client.1.trial078.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:18:45.987 INFO:tasks.workunit.client.1.trial078.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:18:45.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme0n1 /dev/ng0n1 012510B00120 MTFDKCC1T9TGP-1BK1JABYY 0x1 139.78 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:45.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme1n1 /dev/ng1n1 012510B000E6 MTFDKCC1T9TGP-1BK1JABYY 0x1 139.67 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:45.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme2n1 /dev/ng2n1 25174FCD87E6 Micron_7450_MTFDKBA960TFR 0x1 231.65 GB / 960.20 GB 512 B + 0 B E2MU200 ' 2026-02-18T03:18:45.988 INFO:tasks.workunit.client.1.trial078.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:18:45.988 INFO:tasks.workunit.client.1.trial078.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:18:45.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme0n1 /dev/ng0n1 012510B00120 MTFDKCC1T9TGP-1BK1JABYY 0x1 139.78 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:45.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme1n1 /dev/ng1n1 012510B000E6 MTFDKCC1T9TGP-1BK1JABYY 0x1 139.67 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:18:45.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme2n1 /dev/ng2n1 25174FCD87E6 Micron_7450_MTFDKBA960TFR 0x1 231.65 GB / 960.20 GB 512 B + 0 B E2MU200 ' 2026-02-18T03:18:45.988 INFO:tasks.workunit.client.1.trial078.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:18:45.989 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:45.989 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2026-02-18T03:18:45.989 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] disconnect_all test passed! 2026-02-18T03:18:45.990 INFO:tasks.workunit.client.1.trial078.stderr:+ test_run list_subsys 0 2026-02-18T03:18:45.990 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:18:45.990 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:18:45.991 INFO:tasks.workunit.client.1.trial078.stderr:+ list_subsys 0 2026-02-18T03:18:45.991 INFO:tasks.workunit.client.1.trial078.stderr:+ expected_count=0 2026-02-18T03:18:45.991 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr:+ output='[ 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr: "Subsystems":[ 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys0", 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00120", 2026-02-18T03:18:45.999 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme0", 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:04:00.0", 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys1", 2026-02-18T03:18:46.000 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B000E6", 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme1", 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:03:00.0", 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:46.001 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys2", 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD87E6", 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme2", 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:02:00.0", 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:46.002 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:46.003 INFO:tasks.workunit.client.1.trial078.stderr:]' 2026-02-18T03:18:46.004 INFO:tasks.workunit.client.1.trial078.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00120",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B000E6",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD87E6",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:18:46.004 INFO:tasks.workunit.client.1.trial078.stderr:++ grep -o '"tcp"' 2026-02-18T03:18:46.004 INFO:tasks.workunit.client.1.trial078.stderr:++ wc -l 2026-02-18T03:18:46.004 INFO:tasks.workunit.client.1.trial078.stderr:+ multipath=0 2026-02-18T03:18:46.004 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -ne 0 ']' 2026-02-18T03:18:46.004 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:46.004 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:18:46.005 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:18:46.005 INFO:tasks.workunit.client.1.trial078.stderr:+ devices_count=60 2026-02-18T03:18:46.006 INFO:tasks.workunit.client.1.trial078.stderr:+ test_run connect_all 60 2026-02-18T03:18:46.006 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] Running test: connect_all 2026-02-18T03:18:46.007 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] Running test: connect_all' 2026-02-18T03:18:46.007 INFO:tasks.workunit.client.1.trial078.stderr:+ connect_all 60 2026-02-18T03:18:46.007 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo nvme connect-all --traddr=10.20.193.97 --transport=tcp -l 3600 2026-02-18T03:18:46.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:46] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:46.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:46] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:46.405 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:46] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:46.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:46] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:46.406 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:18:46] INFO state.py:603 (81): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:18:46.647 INFO:tasks.workunit.client.0.trial031.stderr:+ sleep 5 2026-02-18T03:18:46.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: pgmap v135: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 170 B/s wr, 13 op/s 2026-02-18T03:18:46.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3727980377' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1813520954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2560647423' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3875457092' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4050663002' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3303097381' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/4238856634' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1137701406' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: pgmap v135: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 170 B/s wr, 13 op/s 2026-02-18T03:18:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3727980377' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1813520954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2560647423' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3875457092' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4050663002' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3303097381' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/4238856634' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1137701406' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: pgmap v135: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 170 B/s wr, 13 op/s 2026-02-18T03:18:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3727980377' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1813520954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2560647423' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3875457092' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4050663002' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3303097381' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/4238856634' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1137701406' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:47.158 INFO:tasks.workunit.client.1.trial078.stderr:+ sleep 5 2026-02-18T03:18:48.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:48 trial097 ceph-mon[21799]: pgmap v136: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 938 B/s wr, 14 op/s 2026-02-18T03:18:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:48 trial119 ceph-mon[24143]: pgmap v136: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 938 B/s wr, 14 op/s 2026-02-18T03:18:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:48 trial114 ceph-mon[23907]: pgmap v136: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 938 B/s wr, 14 op/s 2026-02-18T03:18:49.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:49 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/333753186' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:49.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:49 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/333753186' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:49.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:49 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/333753186' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:50.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:50 trial097 ceph-mon[21799]: pgmap v137: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s rd, 1.2 KiB/s wr, 24 op/s 2026-02-18T03:18:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:50 trial119 ceph-mon[24143]: pgmap v137: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s rd, 1.2 KiB/s wr, 24 op/s 2026-02-18T03:18:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:50 trial114 ceph-mon[23907]: pgmap v137: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s rd, 1.2 KiB/s wr, 24 op/s 2026-02-18T03:18:51.648 INFO:tasks.workunit.client.0.trial031.stderr:+ expected_devices_count=60 2026-02-18T03:18:51.649 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:18:51.649 INFO:tasks.workunit.client.0.trial031.stderr:++ grep -o 'Ceph bdev Controller' 2026-02-18T03:18:51.649 INFO:tasks.workunit.client.0.trial031.stderr:++ wc -l 2026-02-18T03:18:51.679 INFO:tasks.workunit.client.0.trial031.stderr:+ actual_devices=60 2026-02-18T03:18:51.679 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 60 -ne 60 ']' 2026-02-18T03:18:51.680 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:51.680 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] connect_all test passed!' 2026-02-18T03:18:51.680 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] connect_all test passed! 2026-02-18T03:18:51.681 INFO:tasks.workunit.client.0.trial031.stderr:++ echo 10.20.193.97,10.20.193.114,10.20.193.119,10.20.193.194 2026-02-18T03:18:51.681 INFO:tasks.workunit.client.0.trial031.stderr:++ tr -cd , 2026-02-18T03:18:51.681 INFO:tasks.workunit.client.0.trial031.stderr:++ wc -c 2026-02-18T03:18:51.681 INFO:tasks.workunit.client.0.trial031.stderr:+ gateways_count=4 2026-02-18T03:18:51.682 INFO:tasks.workunit.client.0.trial031.stderr:+ multipath_count=12 2026-02-18T03:18:51.682 INFO:tasks.workunit.client.0.trial031.stderr:+ test_run list_subsys 12 2026-02-18T03:18:51.682 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:18:51.682 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:18:51.682 INFO:tasks.workunit.client.0.trial031.stderr:+ list_subsys 12 2026-02-18T03:18:51.683 INFO:tasks.workunit.client.0.trial031.stderr:+ expected_count=12 2026-02-18T03:18:51.683 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:18:51.702 INFO:tasks.workunit.client.0.trial031.stderr:+ output='[ 2026-02-18T03:18:51.702 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.702 INFO:tasks.workunit.client.0.trial031.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:51.702 INFO:tasks.workunit.client.0.trial031.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: "Subsystems":[ 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys0", 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD6BC1", 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme0", 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:02:00.0", 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.703 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys1", 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB5195", 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme1", 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:03:00.0", 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.704 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys8", 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme10", 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.705 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme11", 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme8", 2026-02-18T03:18:51.706 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme9", 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:51.707 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys12", 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme12", 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.708 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme13", 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme14", 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.709 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme15", 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.710 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys2", 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB516F", 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme2", 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"pcie", 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"0000:04:00.0", 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.711 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme-subsys4", 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "Paths":[ 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme4", 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme5", 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.712 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme6", 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: }, 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: { 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: "Name":"nvme7", 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: "Transport":"tcp", 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: "Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.31", 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: "State":"live" 2026-02-18T03:18:51.713 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:51.714 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:51.714 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:51.714 INFO:tasks.workunit.client.0.trial031.stderr: ] 2026-02-18T03:18:51.714 INFO:tasks.workunit.client.0.trial031.stderr: } 2026-02-18T03:18:51.714 INFO:tasks.workunit.client.0.trial031.stderr:]' 2026-02-18T03:18:51.715 INFO:tasks.workunit.client.0.trial031.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD6BC1",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB5195",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys8",' '"NQN":"nqn.2016-06.io.spdk:cnode2",' '"Paths":[' '{' '"Name":"nvme10",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme11",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme8",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme9",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys12",' '"NQN":"nqn.2016-06.io.spdk:cnode3",' '"Paths":[' '{' '"Name":"nvme12",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme13",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme14",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme15",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-112510AB516F",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys4",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"Paths":[' '{' '"Name":"nvme4",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme5",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme6",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '},' '{' '"Name":"nvme7",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.31",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:18:51.715 INFO:tasks.workunit.client.0.trial031.stderr:++ grep -o '"tcp"' 2026-02-18T03:18:51.716 INFO:tasks.workunit.client.0.trial031.stderr:++ wc -l 2026-02-18T03:18:51.716 INFO:tasks.workunit.client.0.trial031.stderr:+ multipath=12 2026-02-18T03:18:51.716 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 12 -ne 12 ']' 2026-02-18T03:18:51.716 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:51.716 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:18:51.716 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:18:51.717 INFO:tasks.workunit.client.0.trial031.stdout:-------------Test Summary------------- 2026-02-18T03:18:51.717 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '-------------Test Summary-------------' 2026-02-18T03:18:51.717 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof] All nvmeof basic tests passed!' 2026-02-18T03:18:51.718 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof] All nvmeof basic tests passed! 2026-02-18T03:18:51.719 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T03:18:51.719 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T03:18:51.785 INFO:tasks.workunit:Running workunits matching nvmeof/fio_test.sh on client.0... 2026-02-18T03:18:51.787 INFO:tasks.workunit:Running workunit nvmeof/fio_test.sh... 2026-02-18T03:18:51.788 DEBUG:teuthology.orchestra.run.trial031:workunit test nvmeof/fio_test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IOSTAT_INTERVAL=10 RBD_POOL=mypool RUNTIME=600 timeout 30m /home/ubuntu/cephtest/clone.client.0/qa/workunits/nvmeof/fio_test.sh --start_ns 1 --end_ns 30 --rbd_iostat 2026-02-18T03:18:51.842 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo yum -y install fio 2026-02-18T03:18:52.139 INFO:tasks.workunit.client.0.trial031.stdout:Last metadata expiration check: 0:05:35 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:18:52.159 INFO:tasks.workunit.client.1.trial078.stderr:+ expected_devices_count=60 2026-02-18T03:18:52.159 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:18:52.160 INFO:tasks.workunit.client.1.trial078.stderr:++ grep -o 'Ceph bdev Controller' 2026-02-18T03:18:52.160 INFO:tasks.workunit.client.1.trial078.stderr:++ wc -l 2026-02-18T03:18:52.193 INFO:tasks.workunit.client.1.trial078.stderr:+ actual_devices=60 2026-02-18T03:18:52.193 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 60 -ne 60 ']' 2026-02-18T03:18:52.193 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:52.193 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] connect_all test passed! 2026-02-18T03:18:52.194 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] connect_all test passed!' 2026-02-18T03:18:52.194 INFO:tasks.workunit.client.1.trial078.stderr:++ echo 10.20.193.97,10.20.193.114,10.20.193.119,10.20.193.194 2026-02-18T03:18:52.194 INFO:tasks.workunit.client.1.trial078.stderr:++ tr -cd , 2026-02-18T03:18:52.194 INFO:tasks.workunit.client.1.trial078.stderr:++ wc -c 2026-02-18T03:18:52.195 INFO:tasks.workunit.client.1.trial078.stderr:+ gateways_count=4 2026-02-18T03:18:52.195 INFO:tasks.workunit.client.1.trial078.stderr:+ multipath_count=12 2026-02-18T03:18:52.195 INFO:tasks.workunit.client.1.trial078.stderr:+ test_run list_subsys 12 2026-02-18T03:18:52.195 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:18:52.196 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:18:52.196 INFO:tasks.workunit.client.1.trial078.stderr:+ list_subsys 12 2026-02-18T03:18:52.196 INFO:tasks.workunit.client.1.trial078.stderr:+ expected_count=12 2026-02-18T03:18:52.196 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr:+ output='[ 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: "Subsystems":[ 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys0", 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00120", 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.216 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme0", 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:04:00.0", 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys1", 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B000E6", 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.217 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme1", 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:03:00.0", 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys8", 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.218 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme10", 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme11", 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.219 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme8", 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme9", 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.220 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys12", 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme12", 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme13", 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.221 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme14", 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme15", 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.222 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys2", 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD87E6", 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme2", 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"pcie", 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"0000:02:00.0", 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.223 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme-subsys4", 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: "Paths":[ 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme4", 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.224 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme5", 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme6", 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: }, 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: { 2026-02-18T03:18:52.225 INFO:tasks.workunit.client.1.trial078.stderr: "Name":"nvme7", 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr: "Transport":"tcp", 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr: "Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.78", 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr: "State":"live" 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr: ] 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr: } 2026-02-18T03:18:52.226 INFO:tasks.workunit.client.1.trial078.stderr:]' 2026-02-18T03:18:52.228 INFO:tasks.workunit.client.0.trial031.stdout:Dependencies resolved. 2026-02-18T03:18:52.228 INFO:tasks.workunit.client.0.trial031.stdout:================================================================================ 2026-02-18T03:18:52.228 INFO:tasks.workunit.client.0.trial031.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:52.228 INFO:tasks.workunit.client.0.trial031.stdout:================================================================================ 2026-02-18T03:18:52.228 INFO:tasks.workunit.client.0.trial031.stdout:Installing: 2026-02-18T03:18:52.228 INFO:tasks.workunit.client.0.trial031.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout:Installing weak dependencies: 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout:Transaction Summary 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout:================================================================================ 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout:Install 7 Packages 2026-02-18T03:18:52.229 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:52.230 INFO:tasks.workunit.client.0.trial031.stdout:Total download size: 6.3 M 2026-02-18T03:18:52.230 INFO:tasks.workunit.client.0.trial031.stdout:Installed size: 8.7 M 2026-02-18T03:18:52.230 INFO:tasks.workunit.client.0.trial031.stdout:Downloading Packages: 2026-02-18T03:18:52.230 INFO:tasks.workunit.client.1.trial078.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00120",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B000E6",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys8",' '"NQN":"nqn.2016-06.io.spdk:cnode2",' '"Paths":[' '{' '"Name":"nvme10",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme11",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme8",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme9",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys12",' '"NQN":"nqn.2016-06.io.spdk:cnode3",' '"Paths":[' '{' '"Name":"nvme12",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme13",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme14",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme15",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD87E6",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys4",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"Paths":[' '{' '"Name":"nvme4",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.97,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme5",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.114,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme6",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.119,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '},' '{' '"Name":"nvme7",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.194,trsvcid=4420,src_addr=10.20.193.78",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:18:52.230 INFO:tasks.workunit.client.1.trial078.stderr:++ grep -o '"tcp"' 2026-02-18T03:18:52.230 INFO:tasks.workunit.client.1.trial078.stderr:++ wc -l 2026-02-18T03:18:52.231 INFO:tasks.workunit.client.1.trial078.stderr:+ multipath=12 2026-02-18T03:18:52.231 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 12 -ne 12 ']' 2026-02-18T03:18:52.231 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:18:52.231 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:18:52.231 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:18:52.231 INFO:tasks.workunit.client.1.trial078.stdout:-------------Test Summary------------- 2026-02-18T03:18:52.232 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '-------------Test Summary-------------' 2026-02-18T03:18:52.232 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof] All nvmeof basic tests passed!' 2026-02-18T03:18:52.233 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof] All nvmeof basic tests passed! 2026-02-18T03:18:52.233 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T03:18:52.233 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2026-02-18T03:18:52.301 INFO:tasks.workunit:Running workunits matching nvmeof/fio_test.sh on client.1... 2026-02-18T03:18:52.303 INFO:tasks.workunit:Running workunit nvmeof/fio_test.sh... 2026-02-18T03:18:52.303 DEBUG:teuthology.orchestra.run.trial078:workunit test nvmeof/fio_test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 IOSTAT_INTERVAL=10 RBD_POOL=mypool RUNTIME=600 timeout 30m /home/ubuntu/cephtest/clone.client.1/qa/workunits/nvmeof/fio_test.sh --start_ns 31 --end_ns 60 2026-02-18T03:18:52.357 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo yum -y install fio 2026-02-18T03:18:52.371 INFO:tasks.workunit.client.0.trial031.stdout:(1/7): fio-engine-libaio-3.35-1.el9.x86_64.rpm 185 kB/s | 16 kB 00:00 2026-02-18T03:18:52.371 INFO:tasks.workunit.client.0.trial031.stdout:(2/7): fio-engine-http-3.35-1.el9.x86_64.rpm 213 kB/s | 18 kB 00:00 2026-02-18T03:18:52.404 INFO:tasks.workunit.client.0.trial031.stdout:(3/7): fio-engine-nbd-3.35-1.el9.x86_64.rpm 450 kB/s | 15 kB 00:00 2026-02-18T03:18:52.405 INFO:tasks.workunit.client.0.trial031.stdout:(4/7): fio-engine-rados-3.35-1.el9.x86_64.rpm 471 kB/s | 16 kB 00:00 2026-02-18T03:18:52.435 INFO:tasks.workunit.client.0.trial031.stdout:(5/7): fio-engine-rbd-3.35-1.el9.x86_64.rpm 514 kB/s | 16 kB 00:00 2026-02-18T03:18:52.440 INFO:tasks.workunit.client.0.trial031.stdout:(6/7): fio-engine-rdma-3.35-1.el9.x86_64.rpm 596 kB/s | 21 kB 00:00 2026-02-18T03:18:52.570 INFO:tasks.workunit.client.0.trial031.stdout:(7/7): fio-3.35-1.el9.x86_64.rpm 22 MB/s | 6.2 MB 00:00 2026-02-18T03:18:52.570 INFO:tasks.workunit.client.0.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:18:52.570 INFO:tasks.workunit.client.0.trial031.stdout:Total 18 MB/s | 6.3 MB 00:00 2026-02-18T03:18:52.642 INFO:tasks.workunit.client.0.trial031.stdout:Running transaction check 2026-02-18T03:18:52.648 INFO:tasks.workunit.client.0.trial031.stdout:Transaction check succeeded. 2026-02-18T03:18:52.648 INFO:tasks.workunit.client.0.trial031.stdout:Running transaction test 2026-02-18T03:18:52.649 INFO:tasks.workunit.client.1.trial078.stdout:Last metadata expiration check: 0:05:42 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:18:52.706 INFO:tasks.workunit.client.0.trial031.stdout:Transaction test succeeded. 2026-02-18T03:18:52.706 INFO:tasks.workunit.client.0.trial031.stdout:Running transaction 2026-02-18T03:18:52.731 INFO:tasks.workunit.client.1.trial078.stdout:Dependencies resolved. 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout:================================================================================ 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout:================================================================================ 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout:Installing: 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout:Installing weak dependencies: 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:18:52.732 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout:Transaction Summary 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout:================================================================================ 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout:Install 7 Packages 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout:Total download size: 6.3 M 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout:Installed size: 8.7 M 2026-02-18T03:18:52.733 INFO:tasks.workunit.client.1.trial078.stdout:Downloading Packages: 2026-02-18T03:18:52.782 INFO:tasks.workunit.client.0.trial031.stdout: Preparing : 1/1 2026-02-18T03:18:52.784 INFO:tasks.workunit.client.0.trial031.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 1/7 2026-02-18T03:18:52.785 INFO:tasks.workunit.client.0.trial031.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 2/7 2026-02-18T03:18:52.786 INFO:tasks.workunit.client.0.trial031.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 3/7 2026-02-18T03:18:52.787 INFO:tasks.workunit.client.0.trial031.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 4/7 2026-02-18T03:18:52.789 INFO:tasks.workunit.client.0.trial031.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 5/7 2026-02-18T03:18:52.848 INFO:tasks.workunit.client.0.trial031.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 6/7 2026-02-18T03:18:52.865 INFO:tasks.workunit.client.0.trial031.stdout: Installing : fio-3.35-1.el9.x86_64 7/7 2026-02-18T03:18:52.868 INFO:tasks.workunit.client.1.trial078.stdout:(1/7): fio-engine-libaio-3.35-1.el9.x86_64.rpm 211 kB/s | 16 kB 00:00 2026-02-18T03:18:52.868 INFO:tasks.workunit.client.1.trial078.stdout:(2/7): fio-engine-http-3.35-1.el9.x86_64.rpm 244 kB/s | 18 kB 00:00 2026-02-18T03:18:52.899 INFO:tasks.workunit.client.1.trial078.stdout:(3/7): fio-engine-nbd-3.35-1.el9.x86_64.rpm 463 kB/s | 15 kB 00:00 2026-02-18T03:18:52.900 INFO:tasks.workunit.client.1.trial078.stdout:(4/7): fio-engine-rados-3.35-1.el9.x86_64.rpm 499 kB/s | 16 kB 00:00 2026-02-18T03:18:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:52 trial097 ceph-mon[21799]: pgmap v138: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 105 KiB/s rd, 1.5 KiB/s wr, 20 op/s 2026-02-18T03:18:52.931 INFO:tasks.workunit.client.1.trial078.stdout:(5/7): fio-engine-rbd-3.35-1.el9.x86_64.rpm 516 kB/s | 16 kB 00:00 2026-02-18T03:18:52.934 INFO:tasks.workunit.client.1.trial078.stdout:(6/7): fio-engine-rdma-3.35-1.el9.x86_64.rpm 598 kB/s | 21 kB 00:00 2026-02-18T03:18:52.961 INFO:tasks.workunit.client.0.trial031.stdout: Running scriptlet: fio-3.35-1.el9.x86_64 7/7 2026-02-18T03:18:52.961 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : fio-3.35-1.el9.x86_64 1/7 2026-02-18T03:18:52.961 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/7 2026-02-18T03:18:52.961 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/7 2026-02-18T03:18:52.961 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/7 2026-02-18T03:18:52.961 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/7 2026-02-18T03:18:52.961 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/7 2026-02-18T03:18:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:52 trial119 ceph-mon[24143]: pgmap v138: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 105 KiB/s rd, 1.5 KiB/s wr, 20 op/s 2026-02-18T03:18:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:52 trial114 ceph-mon[23907]: pgmap v138: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 105 KiB/s rd, 1.5 KiB/s wr, 20 op/s 2026-02-18T03:18:53.019 INFO:tasks.workunit.client.0.trial031.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/7 2026-02-18T03:18:53.019 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.019 INFO:tasks.workunit.client.0.trial031.stdout:Installed: 2026-02-18T03:18:53.019 INFO:tasks.workunit.client.0.trial031.stdout: fio-3.35-1.el9.x86_64 fio-engine-http-3.35-1.el9.x86_64 2026-02-18T03:18:53.019 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-libaio-3.35-1.el9.x86_64 fio-engine-nbd-3.35-1.el9.x86_64 2026-02-18T03:18:53.020 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-rados-3.35-1.el9.x86_64 fio-engine-rbd-3.35-1.el9.x86_64 2026-02-18T03:18:53.020 INFO:tasks.workunit.client.0.trial031.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2026-02-18T03:18:53.020 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.020 INFO:tasks.workunit.client.0.trial031.stdout:Complete! 2026-02-18T03:18:53.049 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo yum -y install sysstat 2026-02-18T03:18:53.074 INFO:tasks.workunit.client.1.trial078.stdout:(7/7): fio-3.35-1.el9.x86_64.rpm 22 MB/s | 6.2 MB 00:00 2026-02-18T03:18:53.074 INFO:tasks.workunit.client.1.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:18:53.074 INFO:tasks.workunit.client.1.trial078.stdout:Total 19 MB/s | 6.3 MB 00:00 2026-02-18T03:18:53.143 INFO:tasks.workunit.client.1.trial078.stdout:Running transaction check 2026-02-18T03:18:53.149 INFO:tasks.workunit.client.1.trial078.stdout:Transaction check succeeded. 2026-02-18T03:18:53.149 INFO:tasks.workunit.client.1.trial078.stdout:Running transaction test 2026-02-18T03:18:53.209 INFO:tasks.workunit.client.1.trial078.stdout:Transaction test succeeded. 2026-02-18T03:18:53.209 INFO:tasks.workunit.client.1.trial078.stdout:Running transaction 2026-02-18T03:18:53.284 INFO:tasks.workunit.client.1.trial078.stdout: Preparing : 1/1 2026-02-18T03:18:53.286 INFO:tasks.workunit.client.1.trial078.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 1/7 2026-02-18T03:18:53.288 INFO:tasks.workunit.client.1.trial078.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 2/7 2026-02-18T03:18:53.289 INFO:tasks.workunit.client.1.trial078.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 3/7 2026-02-18T03:18:53.290 INFO:tasks.workunit.client.1.trial078.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 4/7 2026-02-18T03:18:53.291 INFO:tasks.workunit.client.1.trial078.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 5/7 2026-02-18T03:18:53.348 INFO:tasks.workunit.client.1.trial078.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 6/7 2026-02-18T03:18:53.356 INFO:tasks.workunit.client.0.trial031.stdout:Last metadata expiration check: 0:05:36 ago on Wed 18 Feb 2026 03:13:17 AM UTC. 2026-02-18T03:18:53.366 INFO:tasks.workunit.client.1.trial078.stdout: Installing : fio-3.35-1.el9.x86_64 7/7 2026-02-18T03:18:53.421 INFO:tasks.workunit.client.0.trial031.stdout:Package sysstat-12.5.4-9.el9.x86_64 is already installed. 2026-02-18T03:18:53.439 INFO:tasks.workunit.client.0.trial031.stdout:Dependencies resolved. 2026-02-18T03:18:53.440 INFO:tasks.workunit.client.0.trial031.stdout:Nothing to do. 2026-02-18T03:18:53.440 INFO:tasks.workunit.client.0.trial031.stdout:Complete! 2026-02-18T03:18:53.458 INFO:tasks.workunit.client.1.trial078.stdout: Running scriptlet: fio-3.35-1.el9.x86_64 7/7 2026-02-18T03:18:53.458 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : fio-3.35-1.el9.x86_64 1/7 2026-02-18T03:18:53.458 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/7 2026-02-18T03:18:53.459 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/7 2026-02-18T03:18:53.459 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/7 2026-02-18T03:18:53.459 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/7 2026-02-18T03:18:53.459 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/7 2026-02-18T03:18:53.463 INFO:tasks.workunit.client.0.trial031.stderr:+ namespace_range_start= 2026-02-18T03:18:53.463 INFO:tasks.workunit.client.0.trial031.stderr:+ namespace_range_end= 2026-02-18T03:18:53.463 INFO:tasks.workunit.client.0.trial031.stderr:+ random_devices_count= 2026-02-18T03:18:53.463 INFO:tasks.workunit.client.0.trial031.stderr:+ rbd_iostat=false 2026-02-18T03:18:53.463 INFO:tasks.workunit.client.0.trial031.stderr:+ [[ 5 -gt 0 ]] 2026-02-18T03:18:53.463 INFO:tasks.workunit.client.0.trial031.stderr:+ case "$1" in 2026-02-18T03:18:53.463 INFO:tasks.workunit.client.0.trial031.stderr:+ namespace_range_start=1 2026-02-18T03:18:53.463 INFO:tasks.workunit.client.0.trial031.stderr:+ shift 2 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ [[ 3 -gt 0 ]] 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ case "$1" in 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ namespace_range_end=30 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ shift 2 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ [[ 1 -gt 0 ]] 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ case "$1" in 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ rbd_iostat=true 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ shift 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:+ [[ 0 -gt 0 ]] 2026-02-18T03:18:53.464 INFO:tasks.workunit.client.0.trial031.stderr:++ mktemp -t nvmeof-fio-XXXX 2026-02-18T03:18:53.465 INFO:tasks.workunit.client.0.trial031.stderr:+ fio_file=/tmp/nvmeof-fio-9Sss 2026-02-18T03:18:53.466 INFO:tasks.workunit.client.0.trial031.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:18:53.466 INFO:tasks.workunit.client.0.trial031.stderr:++ jq -r '.Devices | sort_by(.NameSpace) | .[] | select(.ModelNumber == "Ceph bdev Controller") | .DevicePath' 2026-02-18T03:18:53.487 INFO:tasks.workunit.client.0.trial031.stderr:+ all_drives_list='/dev/nvme8n1 2026-02-18T03:18:53.487 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n1 2026-02-18T03:18:53.487 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n1 2026-02-18T03:18:53.487 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n2 2026-02-18T03:18:53.487 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n2 2026-02-18T03:18:53.487 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n2 2026-02-18T03:18:53.487 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n3 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n3 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n3 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n4 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n4 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n4 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n5 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n5 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n5 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n6 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n6 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n6 2026-02-18T03:18:53.488 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n7 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n7 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n7 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n8 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n8 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n8 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n9 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n9 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n9 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n10 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n10 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n10 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n11 2026-02-18T03:18:53.489 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n11 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n11 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n12 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n12 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n12 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n13 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n13 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n13 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n14 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n14 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n14 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n15 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n15 2026-02-18T03:18:53.490 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n15 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n16 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n16 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n16 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n17 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n17 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n17 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n18 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n18 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n18 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n19 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n19 2026-02-18T03:18:53.491 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n19 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n20 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n20 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n20' 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 1 ']' 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:++ echo '/dev/nvme8n1 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n1 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n1 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n2 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n2 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n2 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n3 2026-02-18T03:18:53.492 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n3 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n3 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n4 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n4 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n4 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n5 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n5 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n5 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n6 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n6 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n6 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n7 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n7 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n7 2026-02-18T03:18:53.493 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n8 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n8 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n8 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n9 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n9 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n9 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n10 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n10 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n10 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n11 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n11 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n11 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n12 2026-02-18T03:18:53.494 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n12 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n12 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n13 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n13 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n13 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n14 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n14 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n14 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n15 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n15 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n15 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n16 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n16 2026-02-18T03:18:53.495 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n16 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n17 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n17 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n17 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n18 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n18 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n18 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n19 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n19 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n19 2026-02-18T03:18:53.496 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n20 2026-02-18T03:18:53.497 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n20 2026-02-18T03:18:53.497 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n20' 2026-02-18T03:18:53.497 INFO:tasks.workunit.client.0.trial031.stderr:++ sed -n 1,30p 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:+ selected_drives='/dev/nvme8n1 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n1 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n1 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n2 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n2 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n2 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n3 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n3 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n3 2026-02-18T03:18:53.506 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n4 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n4 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n4 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n5 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n5 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n5 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n6 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n6 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n6 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n7 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n7 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n7 2026-02-18T03:18:53.507 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n8 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n8 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n8 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n9 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n9 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n9 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme8n10 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme12n10 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:/dev/nvme4n10' 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:+ RUNTIME=600 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:+ cat 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n1]' 2026-02-18T03:18:53.508 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n1 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n1]' 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n1 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n1]' 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n1 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n2]' 2026-02-18T03:18:53.509 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n2 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n2]' 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n2 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n2]' 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n2 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n3]' 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n3 2026-02-18T03:18:53.510 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n3]' 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n3 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n3]' 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n3 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n4]' 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n4 2026-02-18T03:18:53.511 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n4]' 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n4 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n4]' 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n4 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.512 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n5]' 2026-02-18T03:18:53.513 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n5 2026-02-18T03:18:53.513 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.513 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.513 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n5]' 2026-02-18T03:18:53.513 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n5 2026-02-18T03:18:53.513 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.513 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n5]' 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n5 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n6]' 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n6 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n6]' 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n6 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.514 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n6]' 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n6 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n7]' 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n7 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n7]' 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n7 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n7]' 2026-02-18T03:18:53.515 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n7 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n8]' 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n8 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n8]' 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n8 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n8]' 2026-02-18T03:18:53.516 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n8 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n9]' 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n9 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n9]' 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n9 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n9]' 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n9 2026-02-18T03:18:53.517 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme8n10]' 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme8n10 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme12n10]' 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme12n10 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[job-/dev/nvme4n10]' 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo filename=/dev/nvme4n10 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '' 2026-02-18T03:18:53.518 INFO:tasks.workunit.client.0.trial031.stderr:+ cat /tmp/nvmeof-fio-9Sss 2026-02-18T03:18:53.519 INFO:tasks.workunit.client.0.trial031.stdout:[global] 2026-02-18T03:18:53.519 INFO:tasks.workunit.client.0.trial031.stdout:ioengine=sync 2026-02-18T03:18:53.519 INFO:tasks.workunit.client.0.trial031.stdout:bsrange=4k-64k 2026-02-18T03:18:53.519 INFO:tasks.workunit.client.0.trial031.stdout:numjobs=1 2026-02-18T03:18:53.519 INFO:tasks.workunit.client.0.trial031.stdout:size=1G 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:time_based=1 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:runtime=600 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:rw=randrw 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:verify=md5 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:verify_fatal=1 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:do_verify=1 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:serialize_overlap=1 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:group_reporting 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:direct=1 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n1] 2026-02-18T03:18:53.520 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n1 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n1] 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n1 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n1] 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n1 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n2] 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n2 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.521 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n2] 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n2 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n2] 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n2 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n3] 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n3 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n3] 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n3 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n3] 2026-02-18T03:18:53.522 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n3 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n4] 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n4 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n4] 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n4 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n4] 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n4 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n5] 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n5 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.523 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n5] 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n5 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n5] 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n5 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n6] 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n6 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n6] 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n6 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n6] 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n6 2026-02-18T03:18:53.524 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n7] 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n7 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n7] 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n7 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n7] 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n7 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n8] 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n8 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n8] 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n8 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.525 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n8] 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n8 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n9] 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n9 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n9] 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n9 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n9] 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n9 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme8n10] 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme8n10 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.526 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme12n10] 2026-02-18T03:18:53.527 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme12n10 2026-02-18T03:18:53.527 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.527 INFO:tasks.workunit.client.0.trial031.stdout:[job-/dev/nvme4n10] 2026-02-18T03:18:53.527 INFO:tasks.workunit.client.0.trial031.stdout:filename=/dev/nvme4n10 2026-02-18T03:18:53.527 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.527 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof.fio] starting fio test... 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/7 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout:Installed: 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout: fio-3.35-1.el9.x86_64 fio-engine-http-3.35-1.el9.x86_64 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-libaio-3.35-1.el9.x86_64 fio-engine-nbd-3.35-1.el9.x86_64 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-rados-3.35-1.el9.x86_64 fio-engine-rbd-3.35-1.el9.x86_64 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:53.528 INFO:tasks.workunit.client.1.trial078.stdout:Complete! 2026-02-18T03:18:53.529 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof.fio] starting fio test...' 2026-02-18T03:18:53.529 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' -n 10 ']' 2026-02-18T03:18:53.529 INFO:tasks.workunit.client.0.trial031.stderr:+ iostat_count=60 2026-02-18T03:18:53.529 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' true = true ']' 2026-02-18T03:18:53.529 INFO:tasks.workunit.client.0.trial031.stderr:+ iterations=120 2026-02-18T03:18:53.529 INFO:tasks.workunit.client.0.trial031.stderr:+ iostat -d -p /dev/nvme8n1 /dev/nvme12n1 /dev/nvme4n1 /dev/nvme8n2 /dev/nvme12n2 /dev/nvme4n2 /dev/nvme8n3 /dev/nvme12n3 /dev/nvme4n3 /dev/nvme8n4 /dev/nvme12n4 /dev/nvme4n4 /dev/nvme8n5 /dev/nvme12n5 /dev/nvme4n5 /dev/nvme8n6 /dev/nvme12n6 /dev/nvme4n6 /dev/nvme8n7 /dev/nvme12n7 /dev/nvme4n7 /dev/nvme8n8 /dev/nvme12n8 /dev/nvme4n8 /dev/nvme8n9 /dev/nvme12n9 /dev/nvme4n9 /dev/nvme8n10 /dev/nvme12n10 /dev/nvme4n10 10 60 -h 2026-02-18T03:18:53.529 INFO:tasks.workunit.client.0.trial031.stderr:+ fio --showcmd /tmp/nvmeof-fio-9Sss 2026-02-18T03:18:53.529 INFO:tasks.workunit.client.0.trial031.stderr:+ timeout 20 rbd perf image iostat mypool --iterations 120 2026-02-18T03:18:53.534 INFO:tasks.workunit.client.0.trial031.stdout:Linux 5.14.0-681.el9.x86_64 (trial031) 02/18/2026 _x86_64_ (24 CPU) 2026-02-18T03:18:53.534 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.534 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:18:53.534 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n1 2026-02-18T03:18:53.534 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n10 2026-02-18T03:18:53.534 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n2 2026-02-18T03:18:53.534 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n3 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n4 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n5 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n6 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n7 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n8 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n9 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n1 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n10 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n2 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n3 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n4 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n5 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n6 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n7 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n8 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n9 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n1 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n10 2026-02-18T03:18:53.535 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n2 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n3 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n4 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n5 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n6 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n7 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n8 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stdout: 0.10 2.1k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n9 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stderr:rbd: waiting for initial image stats 2026-02-18T03:18:53.536 INFO:tasks.workunit.client.0.trial031.stderr: 2026-02-18T03:18:53.545 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo yum -y install sysstat 2026-02-18T03:18:53.632 INFO:tasks.workunit.client.0.trial031.stdout:fio --ioengine=sync --bsrange=4k-64k --numjobs=1 --size=1G --time_based=1 --runtime=600 --rw=randrw --verify=md5 --verify_fatal=1 --do_verify=1 --serialize_overlap=1 --group_reporting --direct=1 --name=job-/dev/nvme8n1 --filename=/dev/nvme8n1 --name=job-/dev/nvme12n1 --filename=/dev/nvme12n1 --name=job-/dev/nvme4n1 --filename=/dev/nvme4n1 --name=job-/dev/nvme8n2 --filename=/dev/nvme8n2 --name=job-/dev/nvme12n2 --filename=/dev/nvme12n2 --name=job-/dev/nvme4n2 --filename=/dev/nvme4n2 --name=job-/dev/nvme8n3 --filename=/dev/nvme8n3 --name=job-/dev/nvme12n3 --filename=/dev/nvme12n3 --name=job-/dev/nvme4n3 --filename=/dev/nvme4n3 --name=job-/dev/nvme8n4 --filename=/dev/nvme8n4 --name=job-/dev/nvme12n4 --filename=/dev/nvme12n4 --name=job-/dev/nvme4n4 --filename=/dev/nvme4n4 --name=job-/dev/nvme8n5 --filename=/dev/nvme8n5 --name=job-/dev/nvme12n5 --filename=/dev/nvme12n5 --name=job-/dev/nvme4n5 --filename=/dev/nvme4n5 --name=job-/dev/nvme8n6 --filename=/dev/nvme8n6 --name=job-/dev/nvme12n6 --filename=/dev/nvme12n6 --name=job-/dev/nvme4n6 --filename=/dev/nvme4n6 --name=job-/dev/nvme8n7 --filename=/dev/nvme8n7 --name=job-/dev/nvme12n7 --filename=/dev/nvme12n7 --name=job-/dev/nvme4n7 --filename=/dev/nvme4n7 --name=job-/dev/nvme8n8 --filename=/dev/nvme8n8 --name=job-/dev/nvme12n8 --filename=/dev/nvme12n8 --name=job-/dev/nvme4n8 --filename=/dev/nvme4n8 --name=job-/dev/nvme8n9 --filename=/dev/nvme8n9 --name=job-/dev/nvme12n9 --filename=/dev/nvme12n9 --name=job-/dev/nvme4n9 --filename=/dev/nvme4n9 --name=job-/dev/nvme8n10 --filename=/dev/nvme8n10 --name=job-/dev/nvme12n10 --filename=/dev/nvme12n10 --name=job-/dev/nvme4n10 --filename=/dev/nvme4n10 2026-02-18T03:18:53.632 INFO:tasks.workunit.client.0.trial031.stderr:+ set +e 2026-02-18T03:18:53.633 INFO:tasks.workunit.client.0.trial031.stderr:+ sudo fio /tmp/nvmeof-fio-9Sss 2026-02-18T03:18:53.783 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n1: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n1: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n1: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n2: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n2: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n2: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.784 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n4: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n4: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n4: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n5: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n5: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n5: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n6: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n6: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n6: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n7: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.785 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n7: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n7: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n8: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n8: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n8: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n9: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n9: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n9: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n10: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme12n10: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme4n10: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:fio-3.35 2026-02-18T03:18:53.786 INFO:tasks.workunit.client.0.trial031.stdout:Starting 30 processes 2026-02-18T03:18:53.841 INFO:tasks.workunit.client.1.trial078.stdout:Last metadata expiration check: 0:05:43 ago on Wed 18 Feb 2026 03:13:10 AM UTC. 2026-02-18T03:18:53.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3406889301' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3771759763' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3722734453' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.906 INFO:tasks.workunit.client.1.trial078.stdout:Package sysstat-12.5.4-9.el9.x86_64 is already installed. 2026-02-18T03:18:53.924 INFO:tasks.workunit.client.1.trial078.stdout:Dependencies resolved. 2026-02-18T03:18:53.924 INFO:tasks.workunit.client.1.trial078.stdout:Nothing to do. 2026-02-18T03:18:53.924 INFO:tasks.workunit.client.1.trial078.stdout:Complete! 2026-02-18T03:18:53.945 INFO:tasks.workunit.client.1.trial078.stderr:+ namespace_range_start= 2026-02-18T03:18:53.945 INFO:tasks.workunit.client.1.trial078.stderr:+ namespace_range_end= 2026-02-18T03:18:53.945 INFO:tasks.workunit.client.1.trial078.stderr:+ random_devices_count= 2026-02-18T03:18:53.945 INFO:tasks.workunit.client.1.trial078.stderr:+ rbd_iostat=false 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ [[ 4 -gt 0 ]] 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ case "$1" in 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ namespace_range_start=31 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ shift 2 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ [[ 2 -gt 0 ]] 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ case "$1" in 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ namespace_range_end=60 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ shift 2 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:+ [[ 0 -gt 0 ]] 2026-02-18T03:18:53.946 INFO:tasks.workunit.client.1.trial078.stderr:++ mktemp -t nvmeof-fio-XXXX 2026-02-18T03:18:53.947 INFO:tasks.workunit.client.1.trial078.stderr:+ fio_file=/tmp/nvmeof-fio-LecP 2026-02-18T03:18:53.947 INFO:tasks.workunit.client.1.trial078.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:18:53.947 INFO:tasks.workunit.client.1.trial078.stderr:++ jq -r '.Devices | sort_by(.NameSpace) | .[] | select(.ModelNumber == "Ceph bdev Controller") | .DevicePath' 2026-02-18T03:18:53.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3406889301' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3771759763' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3722734453' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.969 INFO:tasks.workunit.client.1.trial078.stderr:+ all_drives_list='/dev/nvme8n1 2026-02-18T03:18:53.969 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n1 2026-02-18T03:18:53.969 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n1 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n2 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n2 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n2 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n3 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n3 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n3 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n4 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n4 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n4 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n5 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n5 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n5 2026-02-18T03:18:53.970 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n6 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n6 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n6 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n7 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n7 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n7 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n8 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n8 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n8 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n9 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n9 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n9 2026-02-18T03:18:53.971 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n10 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n10 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n10 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n11 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n11 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n11 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n12 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n12 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n12 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n13 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n13 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n13 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n14 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n14 2026-02-18T03:18:53.972 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n14 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n15 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n15 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n15 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n16 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n16 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n16 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n17 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n17 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n17 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n18 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n18 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n18 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n19 2026-02-18T03:18:53.973 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n19 2026-02-18T03:18:53.974 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n19 2026-02-18T03:18:53.974 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n20 2026-02-18T03:18:53.974 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n20 2026-02-18T03:18:53.974 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n20' 2026-02-18T03:18:53.974 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 31 ']' 2026-02-18T03:18:53.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3406889301' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3771759763' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3722734453' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:53.983 INFO:tasks.workunit.client.1.trial078.stderr:++ echo '/dev/nvme8n1 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n1 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n1 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n2 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n2 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n2 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n3 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n3 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n3 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n4 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n4 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n4 2026-02-18T03:18:53.984 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n5 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n5 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n5 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n6 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n6 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n6 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n7 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n7 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n7 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n8 2026-02-18T03:18:53.985 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n8 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n8 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n9 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n9 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n9 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n10 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n10 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n10 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n11 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n11 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n11 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n12 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n12 2026-02-18T03:18:53.986 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n12 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n13 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n13 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n13 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n14 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n14 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n14 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n15 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n15 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n15 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n16 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n16 2026-02-18T03:18:53.987 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n16 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n17 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n17 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n17 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n18 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n18 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n18 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n19 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n19 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n19 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n20 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n20 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n20' 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:++ sed -n 31,60p 2026-02-18T03:18:53.988 INFO:tasks.workunit.client.1.trial078.stderr:+ selected_drives='/dev/nvme8n11 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n11 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n11 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n12 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n12 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n12 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n13 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n13 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n13 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n14 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n14 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n14 2026-02-18T03:18:53.989 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n15 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n15 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n15 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n16 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n16 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n16 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n17 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n17 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n17 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n18 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n18 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n18 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n19 2026-02-18T03:18:53.990 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n19 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n19 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme8n20 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme12n20 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:/dev/nvme4n20' 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ RUNTIME=600 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ cat 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n11]' 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n11 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n11]' 2026-02-18T03:18:53.991 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n11 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n11]' 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n11 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n12]' 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n12 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n12]' 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n12 2026-02-18T03:18:53.992 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n12]' 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n12 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n13]' 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n13 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n13]' 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n13 2026-02-18T03:18:53.993 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n13]' 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n13 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n14]' 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n14 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n14]' 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n14 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.994 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n14]' 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n14 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n15]' 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n15 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n15]' 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n15 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.995 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n15]' 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n15 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n16]' 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n16 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n16]' 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n16 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n16]' 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n16 2026-02-18T03:18:53.996 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n17]' 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n17 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n17]' 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n17 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n17]' 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n17 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.997 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n18]' 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n18 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n18]' 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n18 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n18]' 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n18 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.998 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n19]' 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n19 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n19]' 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n19 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n19]' 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n19 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme8n20]' 2026-02-18T03:18:53.999 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme8n20 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme12n20]' 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme12n20 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ for i in $selected_drives 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[job-/dev/nvme4n20]' 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ echo filename=/dev/nvme4n20 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '' 2026-02-18T03:18:54.000 INFO:tasks.workunit.client.1.trial078.stderr:+ cat /tmp/nvmeof-fio-LecP 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:[global] 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:ioengine=sync 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:bsrange=4k-64k 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:numjobs=1 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:size=1G 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:time_based=1 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:runtime=600 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:rw=randrw 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:verify=md5 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:verify_fatal=1 2026-02-18T03:18:54.001 INFO:tasks.workunit.client.1.trial078.stdout:do_verify=1 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:serialize_overlap=1 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:group_reporting 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:direct=1 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n11] 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n11 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n11] 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n11 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n11] 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n11 2026-02-18T03:18:54.002 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n12] 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n12 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n12] 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n12 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n12] 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n12 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n13] 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n13 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n13] 2026-02-18T03:18:54.003 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n13 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n13] 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n13 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n14] 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n14 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n14] 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n14 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n14] 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n14 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n15] 2026-02-18T03:18:54.004 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n15 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n15] 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n15 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n15] 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n15 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n16] 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n16 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n16] 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n16 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.005 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n16] 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n16 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n17] 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n17 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n17] 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n17 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n17] 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n17 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n18] 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n18 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n18] 2026-02-18T03:18:54.006 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n18 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n18] 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n18 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n19] 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n19 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n19] 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n19 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n19] 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n19 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme8n20] 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme8n20 2026-02-18T03:18:54.007 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.008 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme12n20] 2026-02-18T03:18:54.008 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme12n20 2026-02-18T03:18:54.008 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.008 INFO:tasks.workunit.client.1.trial078.stdout:[job-/dev/nvme4n20] 2026-02-18T03:18:54.008 INFO:tasks.workunit.client.1.trial078.stdout:filename=/dev/nvme4n20 2026-02-18T03:18:54.008 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.008 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof.fio] starting fio test... 2026-02-18T03:18:54.009 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof.fio] starting fio test...' 2026-02-18T03:18:54.009 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' -n 10 ']' 2026-02-18T03:18:54.009 INFO:tasks.workunit.client.1.trial078.stderr:+ iostat_count=60 2026-02-18T03:18:54.009 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' false = true ']' 2026-02-18T03:18:54.009 INFO:tasks.workunit.client.1.trial078.stderr:+ fio --showcmd /tmp/nvmeof-fio-LecP 2026-02-18T03:18:54.009 INFO:tasks.workunit.client.1.trial078.stderr:+ iostat -d -p /dev/nvme8n11 /dev/nvme12n11 /dev/nvme4n11 /dev/nvme8n12 /dev/nvme12n12 /dev/nvme4n12 /dev/nvme8n13 /dev/nvme12n13 /dev/nvme4n13 /dev/nvme8n14 /dev/nvme12n14 /dev/nvme4n14 /dev/nvme8n15 /dev/nvme12n15 /dev/nvme4n15 /dev/nvme8n16 /dev/nvme12n16 /dev/nvme4n16 /dev/nvme8n17 /dev/nvme12n17 /dev/nvme4n17 /dev/nvme8n18 /dev/nvme12n18 /dev/nvme4n18 /dev/nvme8n19 /dev/nvme12n19 /dev/nvme4n19 /dev/nvme8n20 /dev/nvme12n20 /dev/nvme4n20 10 60 -h 2026-02-18T03:18:54.013 INFO:tasks.workunit.client.1.trial078.stdout:Linux 5.14.0-681.el9.x86_64 (trial078) 02/18/2026 _x86_64_ (24 CPU) 2026-02-18T03:18:54.013 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.013 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n11 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n12 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n13 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n14 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n15 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n16 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n17 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n18 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n19 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n20 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n11 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n12 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n13 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n14 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n15 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n16 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n17 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n18 2026-02-18T03:18:54.014 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n19 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n20 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n11 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n12 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n13 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n14 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n15 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n16 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n17 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n18 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n19 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 0.10 2.0k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n20 2026-02-18T03:18:54.015 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:18:54.114 INFO:tasks.workunit.client.1.trial078.stdout:fio --ioengine=sync --bsrange=4k-64k --numjobs=1 --size=1G --time_based=1 --runtime=600 --rw=randrw --verify=md5 --verify_fatal=1 --do_verify=1 --serialize_overlap=1 --group_reporting --direct=1 --name=job-/dev/nvme8n11 --filename=/dev/nvme8n11 --name=job-/dev/nvme12n11 --filename=/dev/nvme12n11 --name=job-/dev/nvme4n11 --filename=/dev/nvme4n11 --name=job-/dev/nvme8n12 --filename=/dev/nvme8n12 --name=job-/dev/nvme12n12 --filename=/dev/nvme12n12 --name=job-/dev/nvme4n12 --filename=/dev/nvme4n12 --name=job-/dev/nvme8n13 --filename=/dev/nvme8n13 --name=job-/dev/nvme12n13 --filename=/dev/nvme12n13 --name=job-/dev/nvme4n13 --filename=/dev/nvme4n13 --name=job-/dev/nvme8n14 --filename=/dev/nvme8n14 --name=job-/dev/nvme12n14 --filename=/dev/nvme12n14 --name=job-/dev/nvme4n14 --filename=/dev/nvme4n14 --name=job-/dev/nvme8n15 --filename=/dev/nvme8n15 --name=job-/dev/nvme12n15 --filename=/dev/nvme12n15 --name=job-/dev/nvme4n15 --filename=/dev/nvme4n15 --name=job-/dev/nvme8n16 --filename=/dev/nvme8n16 --name=job-/dev/nvme12n16 --filename=/dev/nvme12n16 --name=job-/dev/nvme4n16 --filename=/dev/nvme4n16 --name=job-/dev/nvme8n17 --filename=/dev/nvme8n17 --name=job-/dev/nvme12n17 --filename=/dev/nvme12n17 --name=job-/dev/nvme4n17 --filename=/dev/nvme4n17 --name=job-/dev/nvme8n18 --filename=/dev/nvme8n18 --name=job-/dev/nvme12n18 --filename=/dev/nvme12n18 --name=job-/dev/nvme4n18 --filename=/dev/nvme4n18 --name=job-/dev/nvme8n19 --filename=/dev/nvme8n19 --name=job-/dev/nvme12n19 --filename=/dev/nvme12n19 --name=job-/dev/nvme4n19 --filename=/dev/nvme4n19 --name=job-/dev/nvme8n20 --filename=/dev/nvme8n20 --name=job-/dev/nvme12n20 --filename=/dev/nvme12n20 --name=job-/dev/nvme4n20 --filename=/dev/nvme4n20 2026-02-18T03:18:54.114 INFO:tasks.workunit.client.1.trial078.stderr:+ set +e 2026-02-18T03:18:54.114 INFO:tasks.workunit.client.1.trial078.stderr:+ sudo fio /tmp/nvmeof-fio-LecP 2026-02-18T03:18:54.264 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n11: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.264 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n11: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.264 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n11: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.264 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n12: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n12: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n12: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n13: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n13: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n13: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n14: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n14: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n14: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n15: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n15: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n15: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.265 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n16: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n16: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n16: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n17: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n17: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n17: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n18: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n18: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n18: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n19: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n19: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n19: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.266 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n20: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.267 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme12n20: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.267 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme4n20: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:18:54.267 INFO:tasks.workunit.client.1.trial078.stdout:fio-3.35 2026-02-18T03:18:54.267 INFO:tasks.workunit.client.1.trial078.stdout:Starting 30 processes 2026-02-18T03:18:54.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:54 trial097 ceph-mon[21799]: pgmap v139: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s rd, 1.4 KiB/s wr, 24 op/s 2026-02-18T03:18:54.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:54 trial097 ceph-mon[21799]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:18:54.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:54 trial097 ceph-mon[21799]: { 2026-02-18T03:18:54.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:54 trial097 ceph-mon[21799]: "prefix": "rbd perf image stats", 2026-02-18T03:18:54.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:54 trial097 ceph-mon[21799]: "pool_spec": "mypool", 2026-02-18T03:18:54.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:54 trial097 ceph-mon[21799]: "sort_by": "write_ops", 2026-02-18T03:18:54.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:54 trial097 ceph-mon[21799]: "format": "json" 2026-02-18T03:18:54.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:54 trial097 ceph-mon[21799]: }"]: dispatch 2026-02-18T03:18:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:54 trial119 ceph-mon[24143]: pgmap v139: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s rd, 1.4 KiB/s wr, 24 op/s 2026-02-18T03:18:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:54 trial119 ceph-mon[24143]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:18:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:54 trial119 ceph-mon[24143]: { 2026-02-18T03:18:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:54 trial119 ceph-mon[24143]: "prefix": "rbd perf image stats", 2026-02-18T03:18:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:54 trial119 ceph-mon[24143]: "pool_spec": "mypool", 2026-02-18T03:18:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:54 trial119 ceph-mon[24143]: "sort_by": "write_ops", 2026-02-18T03:18:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:54 trial119 ceph-mon[24143]: "format": "json" 2026-02-18T03:18:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:54 trial119 ceph-mon[24143]: }"]: dispatch 2026-02-18T03:18:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:54 trial114 ceph-mon[23907]: pgmap v139: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s rd, 1.4 KiB/s wr, 24 op/s 2026-02-18T03:18:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:54 trial114 ceph-mon[23907]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:18:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:54 trial114 ceph-mon[23907]: { 2026-02-18T03:18:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:54 trial114 ceph-mon[23907]: "prefix": "rbd perf image stats", 2026-02-18T03:18:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:54 trial114 ceph-mon[23907]: "pool_spec": "mypool", 2026-02-18T03:18:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:54 trial114 ceph-mon[23907]: "sort_by": "write_ops", 2026-02-18T03:18:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:54 trial114 ceph-mon[23907]: "format": "json" 2026-02-18T03:18:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:54 trial114 ceph-mon[23907]: }"]: dispatch 2026-02-18T03:18:56.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:56 trial097 ceph-mon[21799]: pgmap v140: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2026-02-18T03:18:56.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:56 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3442522432' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:56 trial119 ceph-mon[24143]: pgmap v140: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2026-02-18T03:18:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:56 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3442522432' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:56 trial114 ceph-mon[23907]: pgmap v140: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2026-02-18T03:18:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:56 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3442522432' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:18:58.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:58 trial097 ceph-mon[21799]: pgmap v141: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2026-02-18T03:18:58.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:58 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:18:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:58 trial119 ceph-mon[24143]: pgmap v141: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2026-02-18T03:18:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:58 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:18:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:58 trial114 ceph-mon[23907]: pgmap v141: 33 pgs: 33 active+clean; 609 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail; 76 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2026-02-18T03:18:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:58 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:18:59.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:18:59.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: { 2026-02-18T03:18:59.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: "prefix": "rbd perf image stats", 2026-02-18T03:18:59.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: "pool_spec": "mypool", 2026-02-18T03:18:59.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: "sort_by": "write_ops", 2026-02-18T03:18:59.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: "format": "json" 2026-02-18T03:18:59.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: }"]: dispatch 2026-02-18T03:18:59.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:18:59.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:18:59.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:18:59.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:18:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:18:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:18:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: { 2026-02-18T03:18:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: "prefix": "rbd perf image stats", 2026-02-18T03:18:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: "pool_spec": "mypool", 2026-02-18T03:18:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: "sort_by": "write_ops", 2026-02-18T03:18:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: "format": "json" 2026-02-18T03:18:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: }"]: dispatch 2026-02-18T03:18:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:18:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:18:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:18:59.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:18:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:18:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:18:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: { 2026-02-18T03:18:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: "prefix": "rbd perf image stats", 2026-02-18T03:18:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: "pool_spec": "mypool", 2026-02-18T03:18:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: "sort_by": "write_ops", 2026-02-18T03:18:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: "format": "json" 2026-02-18T03:18:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: }"]: dispatch 2026-02-18T03:18:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:18:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:18:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:18:59.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:18:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:19:00.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:00 trial097 ceph-mon[21799]: pgmap v142: 33 pgs: 33 active+clean; 2.8 GiB data, 129 MiB used, 2.7 TiB / 2.7 TiB avail; 1.3 MiB/s rd, 4.9 MiB/s wr, 1.27k op/s 2026-02-18T03:19:00.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3969162748' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:00.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2307757514' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:00.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2335497876' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:00 trial119 ceph-mon[24143]: pgmap v142: 33 pgs: 33 active+clean; 2.8 GiB data, 129 MiB used, 2.7 TiB / 2.7 TiB avail; 1.3 MiB/s rd, 4.9 MiB/s wr, 1.27k op/s 2026-02-18T03:19:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:00 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3969162748' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:00 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2307757514' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:00 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2335497876' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:00 trial114 ceph-mon[23907]: pgmap v142: 33 pgs: 33 active+clean; 2.8 GiB data, 129 MiB used, 2.7 TiB / 2.7 TiB avail; 1.3 MiB/s rd, 4.9 MiB/s wr, 1.27k op/s 2026-02-18T03:19:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:00 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3969162748' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:00 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2307757514' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:00 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2335497876' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:02.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:02 trial097 ceph-mon[21799]: pgmap v143: 33 pgs: 33 active+clean; 20 GiB data, 1.4 GiB used, 2.7 TiB / 2.7 TiB avail; 17 MiB/s rd, 48 MiB/s wr, 7.30k op/s 2026-02-18T03:19:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:02 trial119 ceph-mon[24143]: pgmap v143: 33 pgs: 33 active+clean; 20 GiB data, 1.4 GiB used, 2.7 TiB / 2.7 TiB avail; 17 MiB/s rd, 48 MiB/s wr, 7.30k op/s 2026-02-18T03:19:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:02 trial114 ceph-mon[23907]: pgmap v143: 33 pgs: 33 active+clean; 20 GiB data, 1.4 GiB used, 2.7 TiB / 2.7 TiB avail; 17 MiB/s rd, 48 MiB/s wr, 7.30k op/s 2026-02-18T03:19:03.492 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 242.90 3.9M 4.1M 0.0k 39.3M 41.4M 0.0k nvme12n1 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 233.10 3.9M 3.6M 0.0k 39.3M 35.8M 0.0k nvme12n10 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 233.40 3.8M 3.7M 0.0k 38.1M 37.1M 0.0k nvme12n2 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 235.30 3.7M 4.0M 0.0k 36.8M 39.5M 0.0k nvme12n3 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 214.00 3.5M 3.4M 0.0k 35.4M 33.9M 0.0k nvme12n4 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 218.90 3.6M 3.4M 0.0k 36.4M 34.3M 0.0k nvme12n5 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 244.50 4.2M 3.7M 0.0k 41.5M 37.4M 0.0k nvme12n6 2026-02-18T03:19:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 249.60 4.2M 4.0M 0.0k 41.7M 40.1M 0.0k nvme12n7 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 244.90 4.1M 3.9M 0.0k 41.2M 39.4M 0.0k nvme12n8 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 238.10 3.7M 3.7M 0.0k 37.2M 36.7M 0.0k nvme12n9 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 230.30 3.7M 3.8M 0.0k 37.1M 37.8M 0.0k nvme4n1 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 240.10 3.8M 3.7M 0.0k 38.3M 37.3M 0.0k nvme4n10 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 220.80 3.6M 3.5M 0.0k 36.1M 34.6M 0.0k nvme4n2 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 252.20 4.1M 4.1M 0.0k 40.7M 40.7M 0.0k nvme4n3 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 243.50 4.0M 3.9M 0.0k 40.3M 38.9M 0.0k nvme4n4 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 223.40 3.6M 3.6M 0.0k 35.6M 36.1M 0.0k nvme4n5 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 237.80 3.8M 3.8M 0.0k 38.3M 38.4M 0.0k nvme4n6 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 233.40 4.0M 3.8M 0.0k 39.9M 37.8M 0.0k nvme4n7 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 253.40 4.0M 4.1M 0.0k 40.2M 40.6M 0.0k nvme4n8 2026-02-18T03:19:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 236.90 3.8M 3.9M 0.0k 37.9M 39.0M 0.0k nvme4n9 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 243.10 3.8M 3.8M 0.0k 37.7M 38.3M 0.0k nvme8n1 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 234.50 3.7M 3.6M 0.0k 36.5M 36.3M 0.0k nvme8n10 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 237.00 3.8M 3.8M 0.0k 38.3M 38.1M 0.0k nvme8n2 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 217.10 3.5M 3.5M 0.0k 35.0M 34.5M 0.0k nvme8n3 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 250.20 4.2M 3.9M 0.0k 41.9M 39.4M 0.0k nvme8n4 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 247.90 4.1M 3.8M 0.0k 41.3M 37.5M 0.0k nvme8n5 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 242.60 3.9M 3.7M 0.0k 38.7M 37.4M 0.0k nvme8n6 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 237.90 3.9M 3.7M 0.0k 38.8M 37.5M 0.0k nvme8n7 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 236.20 3.8M 3.7M 0.0k 38.3M 36.8M 0.0k nvme8n8 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 255.10 4.2M 3.9M 0.0k 42.1M 39.2M 0.0k nvme8n9 2026-02-18T03:19:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage3 164/s 117/s 5.2 MiB/s 2.4 MiB/s 2.65 ms 1.03 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage8 161/s 111/s 5.2 MiB/s 2.2 MiB/s 2.57 ms 933.45 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage29 157/s 117/s 5.0 MiB/s 2.3 MiB/s 2.82 ms 969.37 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage47 153/s 118/s 5.0 MiB/s 2.2 MiB/s 2.69 ms 854.26 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage24 153/s 114/s 5.0 MiB/s 2.3 MiB/s 2.68 ms 1.13 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage10 152/s 110/s 4.9 MiB/s 2.2 MiB/s 2.76 ms 1.01 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage43 152/s 95/s 5.0 MiB/s 1.8 MiB/s 2.80 ms 1.04 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage41 151/s 99/s 5.0 MiB/s 1.9 MiB/s 2.77 ms 939.23 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage9 151/s 109/s 4.9 MiB/s 2.2 MiB/s 2.62 ms 866.51 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage21 150/s 110/s 4.7 MiB/s 2.0 MiB/s 2.83 ms 1.08 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage28 149/s 107/s 4.8 MiB/s 2.0 MiB/s 2.92 ms 1.09 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage6 148/s 105/s 4.8 MiB/s 1.9 MiB/s 2.65 ms 987.83 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage26 148/s 108/s 4.7 MiB/s 2.0 MiB/s 2.81 ms 1.11 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage42 148/s 105/s 4.8 MiB/s 2.0 MiB/s 2.90 ms 1.02 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage27 148/s 100/s 4.7 MiB/s 1.8 MiB/s 2.99 ms 1.08 ms 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage46 147/s 104/s 4.7 MiB/s 2.1 MiB/s 2.74 ms 938.27 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage48 146/s 108/s 4.8 MiB/s 2.2 MiB/s 2.77 ms 965.90 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage22 146/s 108/s 4.7 MiB/s 2.0 MiB/s 2.73 ms 964.01 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage49 145/s 99/s 4.6 MiB/s 1.9 MiB/s 2.79 ms 957.84 us 2026-02-18T03:19:03.530 INFO:tasks.workunit.client.0.trial031.stdout:myimage25 145/s 105/s 4.6 MiB/s 2.0 MiB/s 2.81 ms 949.12 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage30 145/s 100/s 4.6 MiB/s 1.9 MiB/s 2.74 ms 1.08 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage4 144/s 106/s 4.8 MiB/s 2.1 MiB/s 2.65 ms 1.02 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage1 143/s 102/s 4.7 MiB/s 2.1 MiB/s 2.75 ms 1.10 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage7 140/s 102/s 4.7 MiB/s 2.1 MiB/s 2.85 ms 1.17 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage5 140/s 94/s 4.5 MiB/s 1.8 MiB/s 2.82 ms 885.67 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage32 139/s 95/s 4.5 MiB/s 1.7 MiB/s 2.95 ms 1.04 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage38 138/s 95/s 4.4 MiB/s 1.8 MiB/s 2.85 ms 936.14 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage14 137/s 89/s 4.5 MiB/s 1.7 MiB/s 2.87 ms 1.02 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage2 137/s 84/s 4.4 MiB/s 1.6 MiB/s 2.91 ms 977.30 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage50 136/s 104/s 4.4 MiB/s 1.9 MiB/s 2.87 ms 1.17 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage53 135/s 84/s 4.5 MiB/s 1.5 MiB/s 2.87 ms 970.81 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage18 135/s 84/s 4.4 MiB/s 1.5 MiB/s 2.79 ms 968.23 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage35 135/s 93/s 4.3 MiB/s 1.7 MiB/s 2.94 ms 1.03 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage33 134/s 83/s 4.3 MiB/s 1.5 MiB/s 2.87 ms 1.08 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage60 133/s 89/s 4.3 MiB/s 1.6 MiB/s 2.89 ms 926.94 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage31 131/s 94/s 4.2 MiB/s 1.7 MiB/s 2.90 ms 919.86 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage37 130/s 80/s 4.2 MiB/s 1.4 MiB/s 3.01 ms 1.04 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage40 130/s 75/s 4.1 MiB/s 1.3 MiB/s 2.88 ms 1.05 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage51 130/s 77/s 4.4 MiB/s 1.3 MiB/s 2.88 ms 919.99 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage57 130/s 90/s 4.3 MiB/s 1.5 MiB/s 2.81 ms 933.99 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage34 129/s 83/s 4.3 MiB/s 1.7 MiB/s 3.10 ms 1.13 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage11 129/s 90/s 4.2 MiB/s 1.8 MiB/s 3.00 ms 932.05 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage45 129/s 85/s 4.2 MiB/s 1.7 MiB/s 2.91 ms 1.08 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage13 128/s 77/s 4.1 MiB/s 1.5 MiB/s 3.06 ms 1.15 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage17 127/s 85/s 4.3 MiB/s 1.8 MiB/s 2.91 ms 995.30 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage36 127/s 87/s 4.0 MiB/s 1.6 MiB/s 2.97 ms 980.13 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage23 127/s 84/s 4.1 MiB/s 1.5 MiB/s 2.82 ms 1.24 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage52 126/s 86/s 4.1 MiB/s 1.6 MiB/s 2.91 ms 987.61 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage59 126/s 82/s 3.9 MiB/s 1.4 MiB/s 2.92 ms 1.11 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage16 126/s 88/s 4.1 MiB/s 1.6 MiB/s 2.87 ms 938.53 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage12 125/s 81/s 4.0 MiB/s 1.5 MiB/s 3.01 ms 1.16 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage58 124/s 87/s 4.2 MiB/s 1.7 MiB/s 2.88 ms 1.20 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage15 124/s 83/s 4.0 MiB/s 1.6 MiB/s 2.86 ms 1.11 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage56 123/s 89/s 4.0 MiB/s 1.8 MiB/s 2.89 ms 1.04 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage19 120/s 76/s 3.9 MiB/s 1.4 MiB/s 3.03 ms 1.10 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage39 120/s 92/s 3.9 MiB/s 1.7 MiB/s 3.00 ms 956.80 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage20 120/s 81/s 3.8 MiB/s 1.6 MiB/s 2.92 ms 1.06 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage44 120/s 77/s 3.9 MiB/s 1.4 MiB/s 2.89 ms 1.01 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage55 115/s 73/s 3.8 MiB/s 1.4 MiB/s 3.02 ms 1.26 ms 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout:myimage54 110/s 73/s 3.6 MiB/s 1.4 MiB/s 3.10 ms 843.67 us 2026-02-18T03:19:03.531 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:03.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:03 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/4222253893' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:03 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/4222253893' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:03 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/4222253893' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:03.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 228.60 3.7M 3.9M 0.0k 36.9M 38.9M 0.0k nvme12n11 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 225.80 3.7M 3.6M 0.0k 36.9M 35.6M 0.0k nvme12n12 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 229.30 3.6M 3.8M 0.0k 36.0M 38.5M 0.0k nvme12n13 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 215.80 3.6M 3.4M 0.0k 35.7M 34.1M 0.0k nvme12n14 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 224.10 3.7M 3.5M 0.0k 37.2M 35.1M 0.0k nvme12n15 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 237.70 4.0M 3.7M 0.0k 40.4M 36.5M 0.0k nvme12n16 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 236.30 4.0M 3.8M 0.0k 39.7M 37.9M 0.0k nvme12n17 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 227.60 3.8M 3.7M 0.0k 38.1M 37.0M 0.0k nvme12n18 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 225.10 3.5M 3.4M 0.0k 35.2M 34.5M 0.0k nvme12n19 2026-02-18T03:19:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 242.60 4.1M 3.7M 0.0k 41.0M 37.2M 0.0k nvme12n20 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 225.40 3.6M 3.7M 0.0k 36.0M 37.3M 0.0k nvme4n11 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 233.80 3.9M 3.6M 0.0k 38.7M 36.2M 0.0k nvme4n12 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 228.80 3.7M 3.7M 0.0k 36.9M 36.7M 0.0k nvme4n13 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 243.60 4.0M 3.9M 0.0k 40.3M 38.9M 0.0k nvme4n14 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 227.90 3.6M 3.7M 0.0k 36.2M 36.7M 0.0k nvme4n15 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 222.90 3.6M 3.6M 0.0k 35.8M 36.1M 0.0k nvme4n16 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 229.00 3.9M 3.7M 0.0k 39.2M 37.1M 0.0k nvme4n17 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 235.70 3.7M 3.8M 0.0k 37.2M 37.9M 0.0k nvme4n18 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 219.90 3.6M 3.6M 0.0k 35.6M 35.7M 0.0k nvme4n19 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 227.60 3.6M 3.6M 0.0k 36.4M 35.5M 0.0k nvme4n20 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 235.30 3.7M 3.7M 0.0k 36.5M 37.0M 0.0k nvme8n11 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 238.20 3.8M 3.8M 0.0k 38.5M 38.4M 0.0k nvme8n12 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 241.90 3.9M 3.8M 0.0k 39.2M 38.2M 0.0k nvme8n13 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 227.70 3.9M 3.6M 0.0k 38.7M 36.1M 0.0k nvme8n14 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 244.60 4.1M 3.7M 0.0k 40.9M 37.0M 0.0k nvme8n15 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 238.40 3.8M 3.7M 0.0k 38.1M 36.7M 0.0k nvme8n16 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 227.30 3.7M 3.6M 0.0k 37.2M 35.8M 0.0k nvme8n17 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 246.70 4.0M 3.8M 0.0k 40.1M 38.3M 0.0k nvme8n18 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 234.90 3.9M 3.6M 0.0k 38.9M 36.0M 0.0k nvme8n19 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 231.70 3.6M 3.6M 0.0k 36.0M 35.8M 0.0k nvme8n20 2026-02-18T03:19:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:04.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:04 trial097 ceph-mon[21799]: pgmap v144: 33 pgs: 33 active+clean; 39 GiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 118 MiB/s wr, 15.27k op/s 2026-02-18T03:19:04.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:04 trial097 ceph-mon[21799]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:19:04.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:04 trial097 ceph-mon[21799]: { 2026-02-18T03:19:04.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:04 trial097 ceph-mon[21799]: "prefix": "rbd perf image stats", 2026-02-18T03:19:04.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:04 trial097 ceph-mon[21799]: "pool_spec": "mypool", 2026-02-18T03:19:04.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:04 trial097 ceph-mon[21799]: "sort_by": "write_ops", 2026-02-18T03:19:04.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:04 trial097 ceph-mon[21799]: "format": "json" 2026-02-18T03:19:04.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:04 trial097 ceph-mon[21799]: }"]: dispatch 2026-02-18T03:19:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:04 trial119 ceph-mon[24143]: pgmap v144: 33 pgs: 33 active+clean; 39 GiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 118 MiB/s wr, 15.27k op/s 2026-02-18T03:19:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:04 trial119 ceph-mon[24143]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:19:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:04 trial119 ceph-mon[24143]: { 2026-02-18T03:19:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:04 trial119 ceph-mon[24143]: "prefix": "rbd perf image stats", 2026-02-18T03:19:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:04 trial119 ceph-mon[24143]: "pool_spec": "mypool", 2026-02-18T03:19:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:04 trial119 ceph-mon[24143]: "sort_by": "write_ops", 2026-02-18T03:19:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:04 trial119 ceph-mon[24143]: "format": "json" 2026-02-18T03:19:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:04 trial119 ceph-mon[24143]: }"]: dispatch 2026-02-18T03:19:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:04 trial114 ceph-mon[23907]: pgmap v144: 33 pgs: 33 active+clean; 39 GiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 118 MiB/s wr, 15.27k op/s 2026-02-18T03:19:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:04 trial114 ceph-mon[23907]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:19:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:04 trial114 ceph-mon[23907]: { 2026-02-18T03:19:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:04 trial114 ceph-mon[23907]: "prefix": "rbd perf image stats", 2026-02-18T03:19:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:04 trial114 ceph-mon[23907]: "pool_spec": "mypool", 2026-02-18T03:19:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:04 trial114 ceph-mon[23907]: "sort_by": "write_ops", 2026-02-18T03:19:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:04 trial114 ceph-mon[23907]: "format": "json" 2026-02-18T03:19:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:04 trial114 ceph-mon[23907]: }"]: dispatch 2026-02-18T03:19:06.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:06 trial097 ceph-mon[21799]: pgmap v145: 33 pgs: 33 active+clean; 43 GiB data, 5.8 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 151 MiB/s wr, 17.85k op/s 2026-02-18T03:19:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:06 trial119 ceph-mon[24143]: pgmap v145: 33 pgs: 33 active+clean; 43 GiB data, 5.8 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 151 MiB/s wr, 17.85k op/s 2026-02-18T03:19:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:06 trial114 ceph-mon[23907]: pgmap v145: 33 pgs: 33 active+clean; 43 GiB data, 5.8 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 151 MiB/s wr, 17.85k op/s 2026-02-18T03:19:07.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:07 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/105161334' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:07.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:07 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3975204869' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:07.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:07 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1867856369' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:07.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:07 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/105161334' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:07.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:07 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3975204869' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:07.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:07 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1867856369' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:07.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:07 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/105161334' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:07.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:07 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3975204869' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:07.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:07 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1867856369' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:08.533 INFO:tasks.workunit.client.0.trial031.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2026-02-18T03:19:08.533 INFO:tasks.workunit.client.0.trial031.stdout:myimage48 179/s 163/s 5.7 MiB/s 3.8 MiB/s 3.72 ms 1.23 ms 2026-02-18T03:19:08.533 INFO:tasks.workunit.client.0.trial031.stdout:myimage31 178/s 161/s 5.4 MiB/s 3.3 MiB/s 3.80 ms 1.11 ms 2026-02-18T03:19:08.533 INFO:tasks.workunit.client.0.trial031.stdout:myimage21 175/s 159/s 5.4 MiB/s 3.3 MiB/s 3.92 ms 1.18 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage41 175/s 166/s 5.8 MiB/s 3.8 MiB/s 3.85 ms 1.22 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage47 175/s 159/s 5.6 MiB/s 3.6 MiB/s 3.76 ms 1.28 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage53 174/s 166/s 5.5 MiB/s 3.7 MiB/s 3.78 ms 1.27 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage38 172/s 173/s 5.4 MiB/s 3.6 MiB/s 3.80 ms 1.13 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage23 171/s 163/s 5.4 MiB/s 3.4 MiB/s 3.83 ms 1.22 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage60 171/s 172/s 5.5 MiB/s 3.9 MiB/s 3.75 ms 1.28 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage32 171/s 164/s 5.2 MiB/s 3.5 MiB/s 3.87 ms 1.24 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage12 171/s 173/s 5.4 MiB/s 3.8 MiB/s 3.85 ms 1.24 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage51 171/s 160/s 5.5 MiB/s 3.7 MiB/s 3.78 ms 1.38 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage57 171/s 165/s 5.5 MiB/s 3.7 MiB/s 3.84 ms 1.21 ms 2026-02-18T03:19:08.534 INFO:tasks.workunit.client.0.trial031.stdout:myimage4 170/s 166/s 5.5 MiB/s 3.9 MiB/s 3.84 ms 1.20 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage5 170/s 168/s 5.4 MiB/s 3.8 MiB/s 3.87 ms 1.15 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage18 170/s 172/s 5.3 MiB/s 3.7 MiB/s 3.75 ms 1.14 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage3 169/s 164/s 5.4 MiB/s 3.8 MiB/s 3.81 ms 1.25 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage55 169/s 164/s 5.3 MiB/s 3.6 MiB/s 3.77 ms 1.31 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage56 169/s 163/s 5.4 MiB/s 3.4 MiB/s 3.99 ms 1.22 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage15 169/s 163/s 5.3 MiB/s 3.5 MiB/s 3.88 ms 1.17 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage25 169/s 160/s 5.3 MiB/s 3.5 MiB/s 4.02 ms 1.18 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage49 169/s 159/s 5.4 MiB/s 3.5 MiB/s 3.84 ms 1.30 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage6 169/s 170/s 5.4 MiB/s 3.9 MiB/s 3.79 ms 1.26 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage8 169/s 176/s 5.2 MiB/s 3.8 MiB/s 3.73 ms 1.14 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage36 168/s 167/s 5.3 MiB/s 3.7 MiB/s 3.84 ms 1.37 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage20 168/s 155/s 5.2 MiB/s 3.2 MiB/s 3.83 ms 1.48 ms 2026-02-18T03:19:08.535 INFO:tasks.workunit.client.0.trial031.stdout:myimage43 168/s 161/s 5.3 MiB/s 3.6 MiB/s 4.04 ms 1.16 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage16 168/s 162/s 5.4 MiB/s 3.6 MiB/s 3.79 ms 1.33 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage19 167/s 163/s 5.4 MiB/s 3.4 MiB/s 3.93 ms 1.18 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage7 167/s 167/s 5.4 MiB/s 3.9 MiB/s 3.83 ms 1.34 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage33 167/s 170/s 5.3 MiB/s 3.6 MiB/s 3.79 ms 1.25 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage10 167/s 156/s 5.1 MiB/s 3.3 MiB/s 3.89 ms 1.22 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage1 167/s 160/s 5.3 MiB/s 3.3 MiB/s 3.84 ms 1.43 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage44 166/s 166/s 5.3 MiB/s 3.7 MiB/s 4.03 ms 1.22 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage13 166/s 164/s 5.4 MiB/s 3.7 MiB/s 3.83 ms 1.23 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage30 166/s 174/s 5.1 MiB/s 3.7 MiB/s 3.84 ms 1.24 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage35 166/s 167/s 5.3 MiB/s 3.7 MiB/s 3.86 ms 1.25 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage52 166/s 160/s 5.3 MiB/s 3.4 MiB/s 3.83 ms 1.32 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage9 165/s 168/s 5.2 MiB/s 3.8 MiB/s 4.01 ms 1.33 ms 2026-02-18T03:19:08.536 INFO:tasks.workunit.client.0.trial031.stdout:myimage22 165/s 154/s 5.2 MiB/s 3.3 MiB/s 3.92 ms 1.29 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage58 165/s 152/s 5.3 MiB/s 3.4 MiB/s 4.00 ms 1.29 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage11 165/s 154/s 5.3 MiB/s 3.2 MiB/s 4.01 ms 1.26 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage26 165/s 166/s 5.2 MiB/s 3.8 MiB/s 3.90 ms 1.25 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage28 164/s 170/s 5.1 MiB/s 3.6 MiB/s 3.83 ms 1.34 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage46 164/s 176/s 5.1 MiB/s 3.8 MiB/s 4.00 ms 1.15 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage54 164/s 164/s 5.2 MiB/s 3.7 MiB/s 3.72 ms 1.26 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage59 164/s 151/s 5.2 MiB/s 3.4 MiB/s 4.06 ms 1.30 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage29 163/s 192/s 5.2 MiB/s 4.4 MiB/s 3.93 ms 1.09 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage39 163/s 174/s 5.2 MiB/s 4.0 MiB/s 3.94 ms 1.33 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage50 163/s 154/s 5.3 MiB/s 3.5 MiB/s 3.91 ms 1.38 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage17 162/s 172/s 5.3 MiB/s 3.8 MiB/s 3.80 ms 1.23 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage14 162/s 168/s 5.2 MiB/s 3.9 MiB/s 3.82 ms 1.34 ms 2026-02-18T03:19:08.537 INFO:tasks.workunit.client.0.trial031.stdout:myimage24 161/s 168/s 5.1 MiB/s 3.7 MiB/s 3.86 ms 1.38 ms 2026-02-18T03:19:08.538 INFO:tasks.workunit.client.0.trial031.stdout:myimage37 161/s 167/s 5.1 MiB/s 3.4 MiB/s 3.84 ms 1.32 ms 2026-02-18T03:19:08.538 INFO:tasks.workunit.client.0.trial031.stdout:myimage2 160/s 168/s 5.0 MiB/s 3.8 MiB/s 3.92 ms 1.22 ms 2026-02-18T03:19:08.538 INFO:tasks.workunit.client.0.trial031.stdout:myimage42 160/s 165/s 5.1 MiB/s 3.6 MiB/s 3.99 ms 1.22 ms 2026-02-18T03:19:08.538 INFO:tasks.workunit.client.0.trial031.stdout:myimage27 160/s 170/s 5.0 MiB/s 3.6 MiB/s 3.92 ms 1.07 ms 2026-02-18T03:19:08.538 INFO:tasks.workunit.client.0.trial031.stdout:myimage34 159/s 170/s 5.0 MiB/s 3.7 MiB/s 4.01 ms 1.23 ms 2026-02-18T03:19:08.538 INFO:tasks.workunit.client.0.trial031.stdout:myimage40 159/s 164/s 4.9 MiB/s 3.4 MiB/s 4.08 ms 1.25 ms 2026-02-18T03:19:08.538 INFO:tasks.workunit.client.0.trial031.stdout:myimage45 157/s 153/s 5.0 MiB/s 3.4 MiB/s 3.81 ms 1.38 ms 2026-02-18T03:19:08.538 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:08.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:08 trial097 ceph-mon[21799]: pgmap v146: 33 pgs: 33 active+clean; 49 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 123 MiB/s rd, 225 MiB/s wr, 22.92k op/s 2026-02-18T03:19:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:08 trial119 ceph-mon[24143]: pgmap v146: 33 pgs: 33 active+clean; 49 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 123 MiB/s rd, 225 MiB/s wr, 22.92k op/s 2026-02-18T03:19:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:08 trial114 ceph-mon[23907]: pgmap v146: 33 pgs: 33 active+clean; 49 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 123 MiB/s rd, 225 MiB/s wr, 22.92k op/s 2026-02-18T03:19:09.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:09 trial097 ceph-mon[21799]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:19:09.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:09 trial097 ceph-mon[21799]: { 2026-02-18T03:19:09.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:09 trial097 ceph-mon[21799]: "prefix": "rbd perf image stats", 2026-02-18T03:19:09.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:09 trial097 ceph-mon[21799]: "pool_spec": "mypool", 2026-02-18T03:19:09.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:09 trial097 ceph-mon[21799]: "sort_by": "write_ops", 2026-02-18T03:19:09.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:09 trial097 ceph-mon[21799]: "format": "json" 2026-02-18T03:19:09.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:09 trial097 ceph-mon[21799]: }"]: dispatch 2026-02-18T03:19:09.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:09 trial119 ceph-mon[24143]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:19:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:09 trial119 ceph-mon[24143]: { 2026-02-18T03:19:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:09 trial119 ceph-mon[24143]: "prefix": "rbd perf image stats", 2026-02-18T03:19:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:09 trial119 ceph-mon[24143]: "pool_spec": "mypool", 2026-02-18T03:19:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:09 trial119 ceph-mon[24143]: "sort_by": "write_ops", 2026-02-18T03:19:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:09 trial119 ceph-mon[24143]: "format": "json" 2026-02-18T03:19:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:09 trial119 ceph-mon[24143]: }"]: dispatch 2026-02-18T03:19:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:09 trial114 ceph-mon[23907]: from='client.39380 -' entity='client.admin' cmd=[ 2026-02-18T03:19:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:09 trial114 ceph-mon[23907]: { 2026-02-18T03:19:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:09 trial114 ceph-mon[23907]: "prefix": "rbd perf image stats", 2026-02-18T03:19:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:09 trial114 ceph-mon[23907]: "pool_spec": "mypool", 2026-02-18T03:19:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:09 trial114 ceph-mon[23907]: "sort_by": "write_ops", 2026-02-18T03:19:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:09 trial114 ceph-mon[23907]: "format": "json" 2026-02-18T03:19:09.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:09 trial114 ceph-mon[23907]: }"]: dispatch 2026-02-18T03:19:10.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:10 trial119 ceph-mon[24143]: pgmap v147: 33 pgs: 33 active+clean; 50 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 142 MiB/s rd, 250 MiB/s wr, 24.56k op/s 2026-02-18T03:19:10.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:10 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3430613847' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:10.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:10 trial097 ceph-mon[21799]: pgmap v147: 33 pgs: 33 active+clean; 50 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 142 MiB/s rd, 250 MiB/s wr, 24.56k op/s 2026-02-18T03:19:10.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:10 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3430613847' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:10.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:10 trial114 ceph-mon[23907]: pgmap v147: 33 pgs: 33 active+clean; 50 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 142 MiB/s rd, 250 MiB/s wr, 24.56k op/s 2026-02-18T03:19:10.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:10 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3430613847' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:12.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:12 trial097 ceph-mon[21799]: pgmap v148: 33 pgs: 33 active+clean; 52 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 180 MiB/s rd, 297 MiB/s wr, 26.62k op/s 2026-02-18T03:19:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:12 trial119 ceph-mon[24143]: pgmap v148: 33 pgs: 33 active+clean; 52 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 180 MiB/s rd, 297 MiB/s wr, 26.62k op/s 2026-02-18T03:19:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:12 trial114 ceph-mon[23907]: pgmap v148: 33 pgs: 33 active+clean; 52 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 180 MiB/s rd, 297 MiB/s wr, 26.62k op/s 2026-02-18T03:19:13.492 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:13.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 246.80 3.8M 4.0M 0.0k 38.4M 39.9M 0.0k nvme12n1 2026-02-18T03:19:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 246.00 3.8M 3.9M 0.0k 38.5M 39.4M 0.0k nvme12n10 2026-02-18T03:19:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 257.40 4.0M 4.0M 0.0k 40.2M 39.8M 0.0k nvme12n2 2026-02-18T03:19:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 259.60 4.0M 3.9M 0.0k 40.3M 39.2M 0.0k nvme12n3 2026-02-18T03:19:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 254.10 4.1M 3.9M 0.0k 40.7M 38.7M 0.0k nvme12n4 2026-02-18T03:19:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 241.70 3.6M 3.9M 0.0k 36.1M 39.3M 0.0k nvme12n5 2026-02-18T03:19:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 264.20 4.1M 4.0M 0.0k 41.3M 40.3M 0.0k nvme12n6 2026-02-18T03:19:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 259.40 4.0M 4.2M 0.0k 39.9M 42.1M 0.0k nvme12n7 2026-02-18T03:19:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 256.90 3.9M 4.0M 0.0k 39.2M 39.6M 0.0k nvme12n8 2026-02-18T03:19:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 253.10 4.0M 4.0M 0.0k 39.6M 40.3M 0.0k nvme12n9 2026-02-18T03:19:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 256.90 3.9M 4.1M 0.0k 39.5M 40.7M 0.0k nvme4n1 2026-02-18T03:19:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 252.50 3.9M 3.9M 0.0k 38.7M 39.3M 0.0k nvme4n10 2026-02-18T03:19:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 257.70 4.2M 3.8M 0.0k 42.4M 38.1M 0.0k nvme4n2 2026-02-18T03:19:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 260.00 4.0M 4.1M 0.0k 40.3M 40.7M 0.0k nvme4n3 2026-02-18T03:19:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 259.20 4.0M 4.0M 0.0k 39.8M 40.3M 0.0k nvme4n4 2026-02-18T03:19:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 265.80 4.3M 4.1M 0.0k 42.6M 41.2M 0.0k nvme4n5 2026-02-18T03:19:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 253.50 4.0M 4.0M 0.0k 39.6M 39.6M 0.0k nvme4n6 2026-02-18T03:19:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 253.70 3.9M 3.9M 0.0k 38.7M 39.2M 0.0k nvme4n7 2026-02-18T03:19:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 265.50 4.1M 4.0M 0.0k 41.0M 39.9M 0.0k nvme4n8 2026-02-18T03:19:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 260.10 4.2M 3.9M 0.0k 42.3M 38.9M 0.0k nvme4n9 2026-02-18T03:19:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 251.40 3.8M 4.0M 0.0k 37.9M 39.7M 0.0k nvme8n1 2026-02-18T03:19:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 261.80 4.2M 3.9M 0.0k 42.3M 39.3M 0.0k nvme8n10 2026-02-18T03:19:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 250.20 3.8M 3.9M 0.0k 38.1M 38.8M 0.0k nvme8n2 2026-02-18T03:19:13.504 INFO:tasks.workunit.client.0.trial031.stdout: 260.50 4.1M 4.0M 0.0k 40.9M 40.3M 0.0k nvme8n3 2026-02-18T03:19:13.504 INFO:tasks.workunit.client.0.trial031.stdout: 255.30 4.1M 3.8M 0.0k 40.7M 38.3M 0.0k nvme8n4 2026-02-18T03:19:13.504 INFO:tasks.workunit.client.0.trial031.stdout: 243.50 3.7M 3.9M 0.0k 37.0M 38.7M 0.0k nvme8n5 2026-02-18T03:19:13.504 INFO:tasks.workunit.client.0.trial031.stdout: 256.00 3.9M 4.0M 0.0k 39.3M 39.5M 0.0k nvme8n6 2026-02-18T03:19:13.504 INFO:tasks.workunit.client.0.trial031.stdout: 261.30 4.1M 3.7M 0.0k 41.4M 37.4M 0.0k nvme8n7 2026-02-18T03:19:13.504 INFO:tasks.workunit.client.0.trial031.stdout: 258.00 3.9M 4.0M 0.0k 39.2M 39.8M 0.0k nvme8n8 2026-02-18T03:19:13.504 INFO:tasks.workunit.client.0.trial031.stdout: 264.00 4.2M 4.2M 0.0k 41.8M 41.6M 0.0k nvme8n9 2026-02-18T03:19:13.505 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:13.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:13.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 244.40 3.8M 4.0M 0.0k 38.4M 39.6M 0.0k nvme12n11 2026-02-18T03:19:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 244.90 3.8M 3.8M 0.0k 38.0M 38.0M 0.0k nvme12n12 2026-02-18T03:19:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 253.70 3.9M 3.8M 0.0k 39.4M 38.2M 0.0k nvme12n13 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 257.30 4.1M 3.9M 0.0k 41.0M 39.2M 0.0k nvme12n14 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 239.40 3.6M 3.9M 0.0k 35.8M 39.0M 0.0k nvme12n15 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 251.30 3.9M 3.8M 0.0k 39.4M 38.0M 0.0k nvme12n16 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 254.30 3.9M 4.2M 0.0k 38.7M 41.6M 0.0k nvme12n17 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 245.30 3.7M 3.8M 0.0k 37.4M 38.0M 0.0k nvme12n18 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 250.20 3.9M 4.0M 0.0k 39.3M 40.4M 0.0k nvme12n19 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 253.10 4.0M 4.0M 0.0k 39.7M 40.1M 0.0k nvme12n20 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 251.20 3.9M 4.0M 0.0k 39.0M 39.6M 0.0k nvme4n11 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 257.60 4.1M 3.8M 0.0k 41.5M 38.5M 0.0k nvme4n12 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 245.50 3.8M 3.9M 0.0k 38.0M 38.7M 0.0k nvme4n13 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 253.10 3.9M 3.9M 0.0k 39.3M 39.3M 0.0k nvme4n14 2026-02-18T03:19:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 261.00 4.2M 4.0M 0.0k 41.9M 40.4M 0.0k nvme4n15 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 252.60 4.0M 4.0M 0.0k 39.7M 40.0M 0.0k nvme4n16 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 250.00 3.8M 3.9M 0.0k 38.3M 38.6M 0.0k nvme4n17 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 256.00 4.0M 3.8M 0.0k 40.3M 38.1M 0.0k nvme4n18 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 254.20 4.1M 3.9M 0.0k 41.1M 38.6M 0.0k nvme4n19 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 240.50 3.7M 3.8M 0.0k 36.5M 37.7M 0.0k nvme4n20 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 257.70 3.9M 4.1M 0.0k 38.9M 40.8M 0.0k nvme8n11 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 256.80 3.9M 4.0M 0.0k 39.0M 39.9M 0.0k nvme8n12 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 241.00 3.8M 3.8M 0.0k 37.6M 37.5M 0.0k nvme8n13 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 253.00 4.0M 3.7M 0.0k 40.0M 37.4M 0.0k nvme8n14 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 254.70 3.9M 4.1M 0.0k 38.7M 40.7M 0.0k nvme8n15 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 242.10 3.8M 3.8M 0.0k 37.6M 37.8M 0.0k nvme8n16 2026-02-18T03:19:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 263.60 4.2M 3.8M 0.0k 41.7M 37.7M 0.0k nvme8n17 2026-02-18T03:19:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 257.00 3.9M 4.0M 0.0k 38.8M 39.6M 0.0k nvme8n18 2026-02-18T03:19:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 242.90 3.9M 3.8M 0.0k 39.1M 38.4M 0.0k nvme8n19 2026-02-18T03:19:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 251.90 4.0M 3.8M 0.0k 40.3M 38.3M 0.0k nvme8n20 2026-02-18T03:19:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:14.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:14 trial097 ceph-mon[21799]: pgmap v149: 33 pgs: 33 active+clean; 53 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 199 MiB/s rd, 298 MiB/s wr, 23.52k op/s 2026-02-18T03:19:14.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/333254819' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:14.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1604972494' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:14.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/698856106' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:14 trial119 ceph-mon[24143]: pgmap v149: 33 pgs: 33 active+clean; 53 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 199 MiB/s rd, 298 MiB/s wr, 23.52k op/s 2026-02-18T03:19:14.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/333254819' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:14.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1604972494' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:14.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/698856106' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:14 trial114 ceph-mon[23907]: pgmap v149: 33 pgs: 33 active+clean; 53 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 199 MiB/s rd, 298 MiB/s wr, 23.52k op/s 2026-02-18T03:19:14.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/333254819' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:14.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1604972494' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:14.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/698856106' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:16.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:16 trial097 ceph-mon[21799]: pgmap v150: 33 pgs: 33 active+clean; 54 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 179 MiB/s rd, 247 MiB/s wr, 16.72k op/s 2026-02-18T03:19:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:16 trial119 ceph-mon[24143]: pgmap v150: 33 pgs: 33 active+clean; 54 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 179 MiB/s rd, 247 MiB/s wr, 16.72k op/s 2026-02-18T03:19:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:16 trial114 ceph-mon[23907]: pgmap v150: 33 pgs: 33 active+clean; 54 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 179 MiB/s rd, 247 MiB/s wr, 16.72k op/s 2026-02-18T03:19:17.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:17 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1600345021' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:17.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:17 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1600345021' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:17.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:17 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1600345021' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:18.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:18 trial097 ceph-mon[21799]: pgmap v151: 33 pgs: 33 active+clean; 54 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 194 MiB/s rd, 257 MiB/s wr, 16.99k op/s 2026-02-18T03:19:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:18 trial119 ceph-mon[24143]: pgmap v151: 33 pgs: 33 active+clean; 54 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 194 MiB/s rd, 257 MiB/s wr, 16.99k op/s 2026-02-18T03:19:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:18 trial114 ceph-mon[23907]: pgmap v151: 33 pgs: 33 active+clean; 54 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 194 MiB/s rd, 257 MiB/s wr, 16.99k op/s 2026-02-18T03:19:20.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:20 trial097 ceph-mon[21799]: pgmap v152: 33 pgs: 33 active+clean; 55 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 154 MiB/s rd, 198 MiB/s wr, 12.93k op/s 2026-02-18T03:19:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:20 trial119 ceph-mon[24143]: pgmap v152: 33 pgs: 33 active+clean; 55 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 154 MiB/s rd, 198 MiB/s wr, 12.93k op/s 2026-02-18T03:19:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:20 trial114 ceph-mon[23907]: pgmap v152: 33 pgs: 33 active+clean; 55 GiB data, 16 GiB used, 2.7 TiB / 2.7 TiB avail; 154 MiB/s rd, 198 MiB/s wr, 12.93k op/s 2026-02-18T03:19:21.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:21 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1318411741' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:21.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:21 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/465238819' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:21.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:21 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/983971858' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:21.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:21 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1318411741' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:21.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:21 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/465238819' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:21.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:21 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/983971858' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:21.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:21 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1318411741' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:21.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:21 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/465238819' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:21.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:21 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/983971858' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:22.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:22 trial097 ceph-mon[21799]: pgmap v153: 33 pgs: 33 active+clean; 55 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 162 MiB/s rd, 206 MiB/s wr, 13.49k op/s 2026-02-18T03:19:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:22 trial119 ceph-mon[24143]: pgmap v153: 33 pgs: 33 active+clean; 55 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 162 MiB/s rd, 206 MiB/s wr, 13.49k op/s 2026-02-18T03:19:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:22 trial114 ceph-mon[23907]: pgmap v153: 33 pgs: 33 active+clean; 55 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 162 MiB/s rd, 206 MiB/s wr, 13.49k op/s 2026-02-18T03:19:23.492 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:23.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 173.80 2.6M 2.7M 0.0k 25.6M 27.1M 0.0k nvme12n1 2026-02-18T03:19:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 172.80 2.8M 2.6M 0.0k 28.3M 25.7M 0.0k nvme12n10 2026-02-18T03:19:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 173.50 2.6M 2.6M 0.0k 25.8M 26.0M 0.0k nvme12n2 2026-02-18T03:19:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 162.30 2.5M 2.6M 0.0k 24.8M 25.6M 0.0k nvme12n3 2026-02-18T03:19:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 169.90 2.5M 2.6M 0.0k 24.8M 25.8M 0.0k nvme12n4 2026-02-18T03:19:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 164.80 2.6M 2.5M 0.0k 26.1M 25.2M 0.0k nvme12n5 2026-02-18T03:19:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 166.40 2.4M 2.5M 0.0k 24.4M 25.5M 0.0k nvme12n6 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 169.40 2.5M 2.6M 0.0k 24.9M 25.8M 0.0k nvme12n7 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 173.20 2.5M 2.6M 0.0k 25.1M 26.2M 0.0k nvme12n8 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 179.20 2.7M 2.6M 0.0k 27.0M 25.9M 0.0k nvme12n9 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 171.90 2.4M 2.6M 0.0k 24.2M 25.8M 0.0k nvme4n1 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 169.50 2.5M 2.6M 0.0k 25.3M 25.7M 0.0k nvme4n10 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 165.70 2.4M 2.5M 0.0k 24.0M 25.2M 0.0k nvme4n2 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 178.20 2.6M 2.7M 0.0k 26.2M 27.3M 0.0k nvme4n3 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 170.10 2.5M 2.6M 0.0k 24.9M 26.2M 0.0k nvme4n4 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 172.60 2.6M 2.6M 0.0k 26.4M 26.1M 0.0k nvme4n5 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 168.50 2.5M 2.5M 0.0k 25.0M 24.7M 0.0k nvme4n6 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 163.20 2.3M 2.5M 0.0k 23.1M 24.6M 0.0k nvme4n7 2026-02-18T03:19:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 174.40 2.7M 2.5M 0.0k 27.2M 25.2M 0.0k nvme4n8 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 166.10 2.4M 2.6M 0.0k 24.0M 26.0M 0.0k nvme4n9 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 167.60 2.5M 2.5M 0.0k 25.1M 24.8M 0.0k nvme8n1 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 175.30 2.5M 2.7M 0.0k 25.4M 27.0M 0.0k nvme8n10 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 170.00 2.5M 2.5M 0.0k 25.3M 25.4M 0.0k nvme8n2 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 176.80 2.7M 2.6M 0.0k 26.7M 26.5M 0.0k nvme8n3 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 165.40 2.4M 2.5M 0.0k 23.6M 25.3M 0.0k nvme8n4 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 169.70 2.6M 2.5M 0.0k 25.7M 25.0M 0.0k nvme8n5 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 167.00 2.3M 2.4M 0.0k 23.0M 24.1M 0.0k nvme8n6 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 168.10 2.5M 2.5M 0.0k 24.8M 25.3M 0.0k nvme8n7 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 167.40 2.6M 2.5M 0.0k 25.6M 25.0M 0.0k nvme8n8 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 177.50 2.9M 2.7M 0.0k 29.1M 27.3M 0.0k nvme8n9 2026-02-18T03:19:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:23.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:23.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 163.90 2.4M 2.6M 0.0k 24.0M 25.8M 0.0k nvme12n11 2026-02-18T03:19:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 173.40 2.6M 2.6M 0.0k 26.3M 26.2M 0.0k nvme12n12 2026-02-18T03:19:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 174.20 2.7M 2.8M 0.0k 26.6M 27.6M 0.0k nvme12n13 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 170.50 2.5M 2.6M 0.0k 24.8M 25.7M 0.0k nvme12n14 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 166.90 2.6M 2.6M 0.0k 26.3M 25.6M 0.0k nvme12n15 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 164.20 2.4M 2.6M 0.0k 24.0M 25.5M 0.0k nvme12n16 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 170.30 2.6M 2.6M 0.0k 25.6M 26.0M 0.0k nvme12n17 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 171.40 2.6M 2.5M 0.0k 25.9M 25.4M 0.0k nvme12n18 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 163.20 2.5M 2.4M 0.0k 24.7M 23.8M 0.0k nvme12n19 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 173.90 2.8M 2.6M 0.0k 28.2M 26.0M 0.0k nvme12n20 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 170.80 2.4M 2.6M 0.0k 24.2M 25.5M 0.0k nvme4n11 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 182.90 2.7M 2.8M 0.0k 26.9M 27.5M 0.0k nvme4n12 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 163.30 2.4M 2.6M 0.0k 24.3M 25.9M 0.0k nvme4n13 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 171.00 2.5M 2.6M 0.0k 24.8M 26.2M 0.0k nvme4n14 2026-02-18T03:19:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 166.90 2.5M 2.5M 0.0k 25.2M 25.3M 0.0k nvme4n15 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 178.70 2.7M 2.5M 0.0k 26.8M 25.5M 0.0k nvme4n16 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 163.50 2.3M 2.5M 0.0k 23.1M 24.6M 0.0k nvme4n17 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 176.80 2.7M 2.7M 0.0k 26.5M 26.6M 0.0k nvme4n18 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 164.10 2.4M 2.6M 0.0k 24.2M 26.0M 0.0k nvme4n19 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 164.30 2.5M 2.5M 0.0k 24.9M 24.8M 0.0k nvme4n20 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 170.00 2.5M 2.5M 0.0k 25.4M 25.1M 0.0k nvme8n11 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 174.20 2.6M 2.6M 0.0k 26.0M 25.7M 0.0k nvme8n12 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 163.80 2.5M 2.4M 0.0k 25.1M 23.7M 0.0k nvme8n13 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 164.60 2.4M 2.6M 0.0k 23.7M 26.1M 0.0k nvme8n14 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 175.80 2.7M 2.5M 0.0k 26.8M 25.5M 0.0k nvme8n15 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 165.00 2.3M 2.3M 0.0k 22.6M 23.0M 0.0k nvme8n16 2026-02-18T03:19:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 163.30 2.4M 2.5M 0.0k 23.8M 25.1M 0.0k nvme8n17 2026-02-18T03:19:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 174.50 2.6M 2.6M 0.0k 26.2M 25.7M 0.0k nvme8n18 2026-02-18T03:19:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 160.60 2.5M 2.5M 0.0k 25.0M 25.0M 0.0k nvme8n19 2026-02-18T03:19:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 167.00 2.5M 2.5M 0.0k 24.5M 25.4M 0.0k nvme8n20 2026-02-18T03:19:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:24.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:24 trial097 ceph-mon[21799]: pgmap v154: 33 pgs: 33 active+clean; 56 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 148 MiB/s rd, 184 MiB/s wr, 12.23k op/s 2026-02-18T03:19:24.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1238973626' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:24 trial119 ceph-mon[24143]: pgmap v154: 33 pgs: 33 active+clean; 56 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 148 MiB/s rd, 184 MiB/s wr, 12.23k op/s 2026-02-18T03:19:24.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1238973626' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:24 trial114 ceph-mon[23907]: pgmap v154: 33 pgs: 33 active+clean; 56 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 148 MiB/s rd, 184 MiB/s wr, 12.23k op/s 2026-02-18T03:19:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1238973626' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:26.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:26 trial097 ceph-mon[21799]: pgmap v155: 33 pgs: 33 active+clean; 56 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 123 MiB/s rd, 152 MiB/s wr, 10.13k op/s 2026-02-18T03:19:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:26 trial119 ceph-mon[24143]: pgmap v155: 33 pgs: 33 active+clean; 56 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 123 MiB/s rd, 152 MiB/s wr, 10.13k op/s 2026-02-18T03:19:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:26 trial114 ceph-mon[23907]: pgmap v155: 33 pgs: 33 active+clean; 56 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 123 MiB/s rd, 152 MiB/s wr, 10.13k op/s 2026-02-18T03:19:28.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:28 trial097 ceph-mon[21799]: pgmap v156: 33 pgs: 33 active+clean; 56 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 135 MiB/s rd, 165 MiB/s wr, 11.07k op/s 2026-02-18T03:19:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2124575121' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2087555780' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:28.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2860428147' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:28 trial119 ceph-mon[24143]: pgmap v156: 33 pgs: 33 active+clean; 56 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 135 MiB/s rd, 165 MiB/s wr, 11.07k op/s 2026-02-18T03:19:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2124575121' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2087555780' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2860428147' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:28 trial114 ceph-mon[23907]: pgmap v156: 33 pgs: 33 active+clean; 56 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 135 MiB/s rd, 165 MiB/s wr, 11.07k op/s 2026-02-18T03:19:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2124575121' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2087555780' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2860428147' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:30.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:30 trial097 ceph-mon[21799]: pgmap v157: 33 pgs: 33 active+clean; 56 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 110 MiB/s rd, 134 MiB/s wr, 9.02k op/s 2026-02-18T03:19:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:30 trial119 ceph-mon[24143]: pgmap v157: 33 pgs: 33 active+clean; 56 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 110 MiB/s rd, 134 MiB/s wr, 9.02k op/s 2026-02-18T03:19:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:30 trial114 ceph-mon[23907]: pgmap v157: 33 pgs: 33 active+clean; 56 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 110 MiB/s rd, 134 MiB/s wr, 9.02k op/s 2026-02-18T03:19:31.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:31 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1311816354' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:31.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:31 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1311816354' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:31.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:31 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1311816354' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:32.875 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:32 trial114 ceph-mon[23907]: pgmap v158: 33 pgs: 33 active+clean; 56 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 119 MiB/s rd, 143 MiB/s wr, 9.72k op/s 2026-02-18T03:19:32.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:32 trial097 ceph-mon[21799]: pgmap v158: 33 pgs: 33 active+clean; 56 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 119 MiB/s rd, 143 MiB/s wr, 9.72k op/s 2026-02-18T03:19:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:32 trial119 ceph-mon[24143]: pgmap v158: 33 pgs: 33 active+clean; 56 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 119 MiB/s rd, 143 MiB/s wr, 9.72k op/s 2026-02-18T03:19:33.492 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:33.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:33.497 INFO:tasks.workunit.client.0.trial031.stdout: 132.00 2.0M 1.9M 0.0k 19.8M 19.0M 0.0k nvme12n1 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 139.40 2.1M 1.9M 0.0k 21.5M 19.4M 0.0k nvme12n10 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 129.40 1.9M 2.0M 0.0k 19.0M 19.9M 0.0k nvme12n2 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 125.70 1.9M 1.9M 0.0k 18.7M 19.2M 0.0k nvme12n3 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 131.60 1.8M 2.0M 0.0k 18.1M 20.0M 0.0k nvme12n4 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 127.20 1.9M 1.9M 0.0k 18.7M 18.8M 0.0k nvme12n5 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 133.00 1.9M 1.9M 0.0k 19.2M 18.7M 0.0k nvme12n6 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 139.40 1.9M 2.0M 0.0k 19.0M 19.8M 0.0k nvme12n7 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 137.10 1.9M 1.9M 0.0k 19.0M 18.9M 0.0k nvme12n8 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 139.10 2.0M 2.0M 0.0k 20.4M 20.2M 0.0k nvme12n9 2026-02-18T03:19:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 132.90 1.8M 1.9M 0.0k 18.1M 19.2M 0.0k nvme4n1 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 138.00 2.1M 1.9M 0.0k 20.5M 19.4M 0.0k nvme4n10 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 134.40 2.0M 2.0M 0.0k 20.0M 19.7M 0.0k nvme4n2 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 140.90 2.0M 2.0M 0.0k 20.2M 20.1M 0.0k nvme4n3 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 134.20 1.9M 2.1M 0.0k 19.1M 20.5M 0.0k nvme4n4 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 128.50 1.8M 1.9M 0.0k 17.9M 18.6M 0.0k nvme4n5 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 131.00 1.9M 1.9M 0.0k 18.8M 19.3M 0.0k nvme4n6 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 136.30 2.0M 2.0M 0.0k 19.6M 19.8M 0.0k nvme4n7 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 133.10 1.8M 1.9M 0.0k 18.2M 18.9M 0.0k nvme4n8 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 144.50 2.3M 2.0M 0.0k 22.9M 20.4M 0.0k nvme4n9 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 136.10 2.0M 1.9M 0.0k 19.7M 19.0M 0.0k nvme8n1 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 140.50 2.1M 2.0M 0.0k 20.5M 20.0M 0.0k nvme8n10 2026-02-18T03:19:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 133.80 1.9M 1.9M 0.0k 18.6M 19.3M 0.0k nvme8n2 2026-02-18T03:19:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 135.90 1.9M 2.0M 0.0k 19.4M 20.0M 0.0k nvme8n3 2026-02-18T03:19:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 126.70 1.9M 1.9M 0.0k 18.5M 18.8M 0.0k nvme8n4 2026-02-18T03:19:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 133.80 2.0M 1.9M 0.0k 20.1M 18.7M 0.0k nvme8n5 2026-02-18T03:19:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 135.50 2.0M 1.9M 0.0k 20.1M 18.6M 0.0k nvme8n6 2026-02-18T03:19:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 136.10 1.9M 2.0M 0.0k 18.8M 20.0M 0.0k nvme8n7 2026-02-18T03:19:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 129.30 1.9M 1.8M 0.0k 18.8M 18.4M 0.0k nvme8n8 2026-02-18T03:19:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 150.10 2.3M 2.1M 0.0k 22.6M 21.1M 0.0k nvme8n9 2026-02-18T03:19:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:33.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:33.982 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 130.90 2.0M 1.8M 0.0k 20.1M 18.4M 0.0k nvme12n11 2026-02-18T03:19:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 132.90 2.0M 2.0M 0.0k 20.0M 19.9M 0.0k nvme12n12 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 128.70 1.9M 2.0M 0.0k 19.1M 19.6M 0.0k nvme12n13 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 132.80 1.8M 2.0M 0.0k 18.4M 20.2M 0.0k nvme12n14 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 126.30 1.9M 1.8M 0.0k 18.6M 18.4M 0.0k nvme12n15 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 127.10 1.8M 1.9M 0.0k 18.0M 18.6M 0.0k nvme12n16 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 128.00 1.8M 1.8M 0.0k 17.5M 18.3M 0.0k nvme12n17 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 125.10 1.7M 1.8M 0.0k 17.2M 17.9M 0.0k nvme12n18 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 132.40 1.9M 1.9M 0.0k 19.4M 19.2M 0.0k nvme12n19 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 138.80 2.1M 2.0M 0.0k 21.1M 19.6M 0.0k nvme12n20 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 130.50 1.8M 1.9M 0.0k 17.8M 19.3M 0.0k nvme4n11 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 132.90 1.9M 1.9M 0.0k 19.4M 19.4M 0.0k nvme4n12 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 130.10 1.9M 1.9M 0.0k 18.6M 18.6M 0.0k nvme4n13 2026-02-18T03:19:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 133.20 1.9M 2.1M 0.0k 18.9M 20.9M 0.0k nvme4n14 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 141.60 2.0M 2.1M 0.0k 20.1M 20.6M 0.0k nvme4n15 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 138.90 2.0M 2.1M 0.0k 20.1M 20.8M 0.0k nvme4n16 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 131.10 1.9M 1.9M 0.0k 18.7M 19.2M 0.0k nvme4n17 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 141.40 2.1M 1.9M 0.0k 20.9M 19.3M 0.0k nvme4n18 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 133.70 2.1M 1.9M 0.0k 20.9M 19.3M 0.0k nvme4n19 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 133.70 2.0M 1.9M 0.0k 20.3M 18.6M 0.0k nvme4n20 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 143.70 2.1M 2.0M 0.0k 20.6M 20.3M 0.0k nvme8n11 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 138.80 1.9M 2.0M 0.0k 19.3M 19.8M 0.0k nvme8n12 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 127.00 1.8M 2.0M 0.0k 18.0M 19.7M 0.0k nvme8n13 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 136.00 2.0M 2.0M 0.0k 20.1M 19.9M 0.0k nvme8n14 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 136.00 1.9M 2.0M 0.0k 19.4M 19.6M 0.0k nvme8n15 2026-02-18T03:19:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 132.50 1.9M 1.9M 0.0k 19.0M 19.2M 0.0k nvme8n16 2026-02-18T03:19:33.985 INFO:tasks.workunit.client.1.trial078.stdout: 134.40 1.9M 1.9M 0.0k 19.2M 19.4M 0.0k nvme8n17 2026-02-18T03:19:33.985 INFO:tasks.workunit.client.1.trial078.stdout: 139.30 2.0M 2.0M 0.0k 20.0M 20.2M 0.0k nvme8n18 2026-02-18T03:19:33.985 INFO:tasks.workunit.client.1.trial078.stdout: 135.30 2.2M 1.9M 0.0k 22.0M 19.4M 0.0k nvme8n19 2026-02-18T03:19:33.985 INFO:tasks.workunit.client.1.trial078.stdout: 137.00 2.0M 2.0M 0.0k 20.3M 19.7M 0.0k nvme8n20 2026-02-18T03:19:33.985 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:34.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:34 trial097 ceph-mon[21799]: pgmap v159: 33 pgs: 33 active+clean; 56 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 112 MiB/s rd, 133 MiB/s wr, 9.14k op/s 2026-02-18T03:19:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:34 trial119 ceph-mon[24143]: pgmap v159: 33 pgs: 33 active+clean; 56 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 112 MiB/s rd, 133 MiB/s wr, 9.14k op/s 2026-02-18T03:19:34.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:34 trial114 ceph-mon[23907]: pgmap v159: 33 pgs: 33 active+clean; 56 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 112 MiB/s rd, 133 MiB/s wr, 9.14k op/s 2026-02-18T03:19:35.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:35 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2427057125' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:35.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:35 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1543856476' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:35.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:35 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/918039270' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:35.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:35 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2427057125' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:35.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:35 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1543856476' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:35.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:35 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/918039270' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:35.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:35 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2427057125' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:35.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:35 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1543856476' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:35.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:35 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/918039270' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:36.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:36 trial097 ceph-mon[21799]: pgmap v160: 33 pgs: 33 active+clean; 56 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 95 MiB/s rd, 113 MiB/s wr, 7.78k op/s 2026-02-18T03:19:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:36 trial119 ceph-mon[24143]: pgmap v160: 33 pgs: 33 active+clean; 56 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 95 MiB/s rd, 113 MiB/s wr, 7.78k op/s 2026-02-18T03:19:36.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:36 trial114 ceph-mon[23907]: pgmap v160: 33 pgs: 33 active+clean; 56 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 95 MiB/s rd, 113 MiB/s wr, 7.78k op/s 2026-02-18T03:19:38.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:38 trial097 ceph-mon[21799]: pgmap v161: 33 pgs: 33 active+clean; 57 GiB data, 24 GiB used, 2.7 TiB / 2.7 TiB avail; 106 MiB/s rd, 126 MiB/s wr, 8.70k op/s 2026-02-18T03:19:38.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:38 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3582544244' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:38 trial119 ceph-mon[24143]: pgmap v161: 33 pgs: 33 active+clean; 57 GiB data, 24 GiB used, 2.7 TiB / 2.7 TiB avail; 106 MiB/s rd, 126 MiB/s wr, 8.70k op/s 2026-02-18T03:19:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:38 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3582544244' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:38 trial114 ceph-mon[23907]: pgmap v161: 33 pgs: 33 active+clean; 57 GiB data, 24 GiB used, 2.7 TiB / 2.7 TiB avail; 106 MiB/s rd, 126 MiB/s wr, 8.70k op/s 2026-02-18T03:19:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:38 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3582544244' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:40.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:40 trial097 ceph-mon[21799]: pgmap v162: 33 pgs: 33 active+clean; 57 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 88 MiB/s rd, 104 MiB/s wr, 7.23k op/s 2026-02-18T03:19:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:40 trial119 ceph-mon[24143]: pgmap v162: 33 pgs: 33 active+clean; 57 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 88 MiB/s rd, 104 MiB/s wr, 7.23k op/s 2026-02-18T03:19:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:40 trial114 ceph-mon[23907]: pgmap v162: 33 pgs: 33 active+clean; 57 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 88 MiB/s rd, 104 MiB/s wr, 7.23k op/s 2026-02-18T03:19:42.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:42 trial097 ceph-mon[21799]: pgmap v163: 33 pgs: 33 active+clean; 57 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 96 MiB/s rd, 113 MiB/s wr, 7.91k op/s 2026-02-18T03:19:43.020 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:42 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4246448076' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.021 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:42 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/4178667152' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.021 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:42 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3668384466' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:42 trial114 ceph-mon[23907]: pgmap v163: 33 pgs: 33 active+clean; 57 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 96 MiB/s rd, 113 MiB/s wr, 7.91k op/s 2026-02-18T03:19:43.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:42 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4246448076' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:42 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/4178667152' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.023 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:42 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3668384466' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.023 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:42 trial119 ceph-mon[24143]: pgmap v163: 33 pgs: 33 active+clean; 57 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 96 MiB/s rd, 113 MiB/s wr, 7.91k op/s 2026-02-18T03:19:43.023 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:42 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4246448076' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.024 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:42 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/4178667152' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.024 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:42 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3668384466' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:43.492 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:43.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 102.90 1.5M 1.6M 0.0k 14.6M 15.7M 0.0k nvme12n1 2026-02-18T03:19:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 104.90 1.4M 1.6M 0.0k 14.3M 15.8M 0.0k nvme12n10 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 115.90 1.6M 1.6M 0.0k 16.5M 16.2M 0.0k nvme12n2 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 114.80 1.7M 1.7M 0.0k 16.7M 16.9M 0.0k nvme12n3 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 112.30 1.7M 1.6M 0.0k 17.1M 16.4M 0.0k nvme12n4 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 102.60 1.5M 1.6M 0.0k 14.5M 15.9M 0.0k nvme12n5 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 114.50 1.6M 1.6M 0.0k 16.4M 16.0M 0.0k nvme12n6 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 117.70 1.5M 1.8M 0.0k 15.4M 17.7M 0.0k nvme12n7 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 112.80 1.6M 1.6M 0.0k 16.4M 16.3M 0.0k nvme12n8 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 114.50 1.7M 1.6M 0.0k 16.6M 16.5M 0.0k nvme12n9 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 110.00 1.6M 1.7M 0.0k 16.0M 16.7M 0.0k nvme4n1 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 112.90 1.6M 1.6M 0.0k 16.3M 16.3M 0.0k nvme4n10 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 112.30 1.6M 1.6M 0.0k 16.0M 16.0M 0.0k nvme4n2 2026-02-18T03:19:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 112.40 1.6M 1.6M 0.0k 15.9M 15.8M 0.0k nvme4n3 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 111.10 1.5M 1.6M 0.0k 14.9M 16.4M 0.0k nvme4n4 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 120.50 1.7M 1.6M 0.0k 17.1M 16.2M 0.0k nvme4n5 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 113.60 1.7M 1.7M 0.0k 17.1M 16.6M 0.0k nvme4n6 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 113.80 1.6M 1.6M 0.0k 16.0M 16.0M 0.0k nvme4n7 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 114.40 1.7M 1.6M 0.0k 16.8M 16.0M 0.0k nvme4n8 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 109.10 1.5M 1.7M 0.0k 15.0M 16.6M 0.0k nvme4n9 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 115.10 1.6M 1.7M 0.0k 16.2M 17.0M 0.0k nvme8n1 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 113.40 1.6M 1.7M 0.0k 15.9M 16.7M 0.0k nvme8n10 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 116.90 1.7M 1.6M 0.0k 17.3M 16.2M 0.0k nvme8n2 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 113.10 1.5M 1.7M 0.0k 15.4M 16.9M 0.0k nvme8n3 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 108.60 1.4M 1.6M 0.0k 14.3M 15.8M 0.0k nvme8n4 2026-02-18T03:19:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 105.00 1.4M 1.6M 0.0k 13.8M 16.0M 0.0k nvme8n5 2026-02-18T03:19:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 112.60 1.6M 1.6M 0.0k 15.7M 16.1M 0.0k nvme8n6 2026-02-18T03:19:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 122.50 1.7M 1.7M 0.0k 17.4M 16.6M 0.0k nvme8n7 2026-02-18T03:19:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 110.50 1.6M 1.6M 0.0k 15.7M 15.9M 0.0k nvme8n8 2026-02-18T03:19:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 119.20 1.6M 1.7M 0.0k 16.3M 17.4M 0.0k nvme8n9 2026-02-18T03:19:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:43.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:43.984 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 105.90 1.5M 1.7M 0.0k 14.6M 16.6M 0.0k nvme12n11 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 112.60 1.5M 1.7M 0.0k 15.4M 16.5M 0.0k nvme12n12 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 110.30 1.6M 1.6M 0.0k 16.1M 16.1M 0.0k nvme12n13 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 122.10 1.8M 1.8M 0.0k 18.3M 17.7M 0.0k nvme12n14 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 107.70 1.5M 1.7M 0.0k 15.1M 17.0M 0.0k nvme12n15 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 117.70 1.8M 1.6M 0.0k 17.7M 15.6M 0.0k nvme12n16 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 111.50 1.4M 1.7M 0.0k 14.3M 16.6M 0.0k nvme12n17 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 106.00 1.5M 1.5M 0.0k 15.1M 15.1M 0.0k nvme12n18 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 114.90 1.7M 1.6M 0.0k 16.8M 16.3M 0.0k nvme12n19 2026-02-18T03:19:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 110.90 1.5M 1.7M 0.0k 14.6M 16.5M 0.0k nvme12n20 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 111.40 1.6M 1.7M 0.0k 15.8M 16.8M 0.0k nvme4n11 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 123.60 1.8M 1.6M 0.0k 18.3M 16.4M 0.0k nvme4n12 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 110.30 1.6M 1.6M 0.0k 16.1M 15.6M 0.0k nvme4n13 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 108.50 1.5M 1.6M 0.0k 14.5M 15.5M 0.0k nvme4n14 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 115.80 1.6M 1.5M 0.0k 16.4M 15.4M 0.0k nvme4n15 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 115.10 1.7M 1.7M 0.0k 17.0M 17.1M 0.0k nvme4n16 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 113.50 1.6M 1.6M 0.0k 16.1M 16.2M 0.0k nvme4n17 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 114.40 1.6M 1.6M 0.0k 15.9M 16.4M 0.0k nvme4n18 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 108.60 1.5M 1.6M 0.0k 15.3M 15.7M 0.0k nvme4n19 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 107.40 1.6M 1.5M 0.0k 15.6M 15.3M 0.0k nvme4n20 2026-02-18T03:19:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 125.40 1.8M 1.9M 0.0k 17.7M 18.5M 0.0k nvme8n11 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 120.40 1.8M 1.7M 0.0k 17.7M 16.8M 0.0k nvme8n12 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 107.00 1.5M 1.5M 0.0k 14.7M 15.4M 0.0k nvme8n13 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 105.00 1.4M 1.5M 0.0k 14.2M 15.3M 0.0k nvme8n14 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 103.00 1.4M 1.5M 0.0k 14.3M 15.2M 0.0k nvme8n15 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 113.70 1.7M 1.5M 0.0k 16.8M 15.5M 0.0k nvme8n16 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 116.70 1.6M 1.6M 0.0k 16.0M 16.2M 0.0k nvme8n17 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 114.60 1.7M 1.6M 0.0k 17.0M 16.2M 0.0k nvme8n18 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 107.90 1.5M 1.6M 0.0k 15.2M 15.8M 0.0k nvme8n19 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 114.40 1.6M 1.6M 0.0k 16.5M 16.4M 0.0k nvme8n20 2026-02-18T03:19:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:44 trial097 ceph-mon[21799]: pgmap v164: 33 pgs: 33 active+clean; 57 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 91 MiB/s rd, 108 MiB/s wr, 7.57k op/s 2026-02-18T03:19:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:44 trial119 ceph-mon[24143]: pgmap v164: 33 pgs: 33 active+clean; 57 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 91 MiB/s rd, 108 MiB/s wr, 7.57k op/s 2026-02-18T03:19:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:44 trial114 ceph-mon[23907]: pgmap v164: 33 pgs: 33 active+clean; 57 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 91 MiB/s rd, 108 MiB/s wr, 7.57k op/s 2026-02-18T03:19:45.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1663842046' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1663842046' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:45.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1663842046' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:46.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:46 trial097 ceph-mon[21799]: pgmap v165: 33 pgs: 33 active+clean; 57 GiB data, 27 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s rd, 93 MiB/s wr, 6.53k op/s 2026-02-18T03:19:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:46 trial119 ceph-mon[24143]: pgmap v165: 33 pgs: 33 active+clean; 57 GiB data, 27 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s rd, 93 MiB/s wr, 6.53k op/s 2026-02-18T03:19:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:46 trial114 ceph-mon[23907]: pgmap v165: 33 pgs: 33 active+clean; 57 GiB data, 27 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s rd, 93 MiB/s wr, 6.53k op/s 2026-02-18T03:19:48.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:48 trial097 ceph-mon[21799]: pgmap v166: 33 pgs: 33 active+clean; 57 GiB data, 27 GiB used, 2.7 TiB / 2.7 TiB avail; 88 MiB/s rd, 105 MiB/s wr, 7.34k op/s 2026-02-18T03:19:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:48 trial119 ceph-mon[24143]: pgmap v166: 33 pgs: 33 active+clean; 57 GiB data, 27 GiB used, 2.7 TiB / 2.7 TiB avail; 88 MiB/s rd, 105 MiB/s wr, 7.34k op/s 2026-02-18T03:19:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:48 trial114 ceph-mon[23907]: pgmap v166: 33 pgs: 33 active+clean; 57 GiB data, 27 GiB used, 2.7 TiB / 2.7 TiB avail; 88 MiB/s rd, 105 MiB/s wr, 7.34k op/s 2026-02-18T03:19:49.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:49 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1424600188' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:49.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:49 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2158488071' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:49.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:49 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/4162101351' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:49.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:49 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1424600188' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:49.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:49 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2158488071' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:49.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:49 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/4162101351' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:49.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:49 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1424600188' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:49.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:49 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2158488071' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:49.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:49 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/4162101351' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:50.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:50 trial097 ceph-mon[21799]: pgmap v167: 33 pgs: 33 active+clean; 57 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s rd, 87 MiB/s wr, 6.16k op/s 2026-02-18T03:19:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:50 trial119 ceph-mon[24143]: pgmap v167: 33 pgs: 33 active+clean; 57 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s rd, 87 MiB/s wr, 6.16k op/s 2026-02-18T03:19:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:50 trial114 ceph-mon[23907]: pgmap v167: 33 pgs: 33 active+clean; 57 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 74 MiB/s rd, 87 MiB/s wr, 6.16k op/s 2026-02-18T03:19:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:52 trial097 ceph-mon[21799]: pgmap v168: 33 pgs: 33 active+clean; 57 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s rd, 96 MiB/s wr, 6.79k op/s 2026-02-18T03:19:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:52 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1962257857' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:52 trial119 ceph-mon[24143]: pgmap v168: 33 pgs: 33 active+clean; 57 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s rd, 96 MiB/s wr, 6.79k op/s 2026-02-18T03:19:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:52 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1962257857' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:52 trial114 ceph-mon[23907]: pgmap v168: 33 pgs: 33 active+clean; 57 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 82 MiB/s rd, 96 MiB/s wr, 6.79k op/s 2026-02-18T03:19:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:52 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1962257857' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:53.492 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:53.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:53.497 INFO:tasks.workunit.client.0.trial031.stdout: 100.20 1.5M 1.4M 0.0k 14.5M 14.0M 0.0k nvme12n1 2026-02-18T03:19:53.497 INFO:tasks.workunit.client.0.trial031.stdout: 96.20 1.2M 1.4M 0.0k 12.4M 13.9M 0.0k nvme12n10 2026-02-18T03:19:53.497 INFO:tasks.workunit.client.0.trial031.stdout: 114.40 1.6M 1.5M 0.0k 16.5M 15.2M 0.0k nvme12n2 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 101.20 1.4M 1.4M 0.0k 14.2M 14.3M 0.0k nvme12n3 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 96.50 1.3M 1.3M 0.0k 13.2M 13.2M 0.0k nvme12n4 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.4M 1.4M 0.0k 14.0M 14.2M 0.0k nvme12n5 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 100.10 1.3M 1.3M 0.0k 13.4M 13.2M 0.0k nvme12n6 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 104.20 1.4M 1.5M 0.0k 13.7M 14.7M 0.0k nvme12n7 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 105.70 1.5M 1.5M 0.0k 14.7M 15.0M 0.0k nvme12n8 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 103.10 1.4M 1.5M 0.0k 14.0M 15.0M 0.0k nvme12n9 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 105.00 1.5M 1.4M 0.0k 14.6M 14.3M 0.0k nvme4n1 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 106.50 1.4M 1.5M 0.0k 14.5M 15.2M 0.0k nvme4n10 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 103.90 1.5M 1.3M 0.0k 15.1M 12.8M 0.0k nvme4n2 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1.3M 1.4M 0.0k 12.8M 14.3M 0.0k nvme4n3 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 105.70 1.6M 1.4M 0.0k 15.8M 14.0M 0.0k nvme4n4 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 101.90 1.3M 1.4M 0.0k 13.0M 14.2M 0.0k nvme4n5 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.3M 1.4M 0.0k 12.6M 14.1M 0.0k nvme4n6 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 97.80 1.3M 1.4M 0.0k 13.1M 13.6M 0.0k nvme4n7 2026-02-18T03:19:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 97.20 1.3M 1.3M 0.0k 13.4M 13.4M 0.0k nvme4n8 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.30 1.3M 1.3M 0.0k 12.8M 13.4M 0.0k nvme4n9 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 104.20 1.5M 1.4M 0.0k 15.1M 14.4M 0.0k nvme8n1 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 101.30 1.4M 1.5M 0.0k 14.2M 15.0M 0.0k nvme8n10 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 106.50 1.6M 1.5M 0.0k 15.6M 14.8M 0.0k nvme8n2 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 100.20 1.4M 1.4M 0.0k 14.1M 13.8M 0.0k nvme8n3 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.50 1.4M 1.3M 0.0k 13.6M 13.4M 0.0k nvme8n4 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.60 1.3M 1.4M 0.0k 12.9M 14.0M 0.0k nvme8n5 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.30 1.4M 1.3M 0.0k 13.7M 13.4M 0.0k nvme8n6 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 101.20 1.4M 1.4M 0.0k 14.0M 14.0M 0.0k nvme8n7 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.3M 1.3M 0.0k 13.3M 13.4M 0.0k nvme8n8 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 105.60 1.5M 1.6M 0.0k 14.6M 15.7M 0.0k nvme8n9 2026-02-18T03:19:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:19:53.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:53.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:19:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.10 1.4M 1.5M 0.0k 14.3M 14.5M 0.0k nvme12n11 2026-02-18T03:19:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 104.20 1.5M 1.4M 0.0k 15.2M 13.7M 0.0k nvme12n12 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 101.70 1.4M 1.4M 0.0k 14.3M 14.4M 0.0k nvme12n13 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 104.40 1.4M 1.4M 0.0k 14.3M 14.5M 0.0k nvme12n14 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 102.50 1.5M 1.5M 0.0k 14.9M 14.9M 0.0k nvme12n15 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.3M 1.3M 0.0k 13.1M 12.6M 0.0k nvme12n16 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 103.80 1.4M 1.4M 0.0k 14.0M 14.4M 0.0k nvme12n17 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.4M 1.3M 0.0k 13.7M 13.4M 0.0k nvme12n18 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 101.80 1.4M 1.5M 0.0k 14.3M 14.8M 0.0k nvme12n19 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 102.20 1.4M 1.5M 0.0k 14.1M 14.7M 0.0k nvme12n20 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 1.4M 1.4M 0.0k 14.0M 13.8M 0.0k nvme4n11 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 110.60 1.6M 1.5M 0.0k 15.5M 14.8M 0.0k nvme4n12 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.60 1.4M 1.4M 0.0k 13.6M 13.6M 0.0k nvme4n13 2026-02-18T03:19:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 101.20 1.5M 1.4M 0.0k 14.9M 13.7M 0.0k nvme4n14 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 1.3M 1.4M 0.0k 12.6M 13.9M 0.0k nvme4n15 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 101.90 1.4M 1.5M 0.0k 13.6M 15.0M 0.0k nvme4n16 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 1.3M 1.3M 0.0k 13.0M 13.2M 0.0k nvme4n17 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 1.4M 1.4M 0.0k 13.6M 14.0M 0.0k nvme4n18 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 102.50 1.4M 1.5M 0.0k 13.6M 14.7M 0.0k nvme4n19 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.3M 1.4M 0.0k 12.6M 14.1M 0.0k nvme4n20 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 109.30 1.6M 1.5M 0.0k 16.0M 14.6M 0.0k nvme8n11 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 103.50 1.6M 1.5M 0.0k 15.6M 14.5M 0.0k nvme8n12 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 98.10 1.4M 1.4M 0.0k 13.9M 13.7M 0.0k nvme8n13 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 1.4M 1.3M 0.0k 13.6M 13.5M 0.0k nvme8n14 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 98.00 1.3M 1.4M 0.0k 12.9M 14.1M 0.0k nvme8n15 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 100.10 1.4M 1.4M 0.0k 13.8M 14.3M 0.0k nvme8n16 2026-02-18T03:19:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 106.60 1.5M 1.4M 0.0k 15.4M 14.2M 0.0k nvme8n17 2026-02-18T03:19:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 100.50 1.4M 1.4M 0.0k 14.3M 14.0M 0.0k nvme8n18 2026-02-18T03:19:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1.3M 1.3M 0.0k 12.9M 13.2M 0.0k nvme8n19 2026-02-18T03:19:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 1.4M 1.5M 0.0k 13.9M 15.5M 0.0k nvme8n20 2026-02-18T03:19:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:19:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:54 trial119 ceph-mon[24143]: pgmap v169: 33 pgs: 33 active+clean; 57 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 85 MiB/s wr, 6.01k op/s 2026-02-18T03:19:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:54 trial114 ceph-mon[23907]: pgmap v169: 33 pgs: 33 active+clean; 57 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 85 MiB/s wr, 6.01k op/s 2026-02-18T03:19:55.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:54 trial097 ceph-mon[21799]: pgmap v169: 33 pgs: 33 active+clean; 57 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 85 MiB/s wr, 6.01k op/s 2026-02-18T03:19:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:56 trial119 ceph-mon[24143]: pgmap v170: 33 pgs: 33 active+clean; 57 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 80 MiB/s wr, 5.72k op/s 2026-02-18T03:19:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:56 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2002825961' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:56 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1149886116' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:56 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1293848876' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:56 trial114 ceph-mon[23907]: pgmap v170: 33 pgs: 33 active+clean; 57 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 80 MiB/s wr, 5.72k op/s 2026-02-18T03:19:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:56 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2002825961' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:56 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1149886116' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:56 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1293848876' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:57.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:56 trial097 ceph-mon[21799]: pgmap v170: 33 pgs: 33 active+clean; 57 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 80 MiB/s wr, 5.72k op/s 2026-02-18T03:19:57.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:56 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2002825961' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:57.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:56 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1149886116' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:57.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:56 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1293848876' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:58 trial119 ceph-mon[24143]: pgmap v171: 33 pgs: 33 active+clean; 57 GiB data, 30 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s rd, 91 MiB/s wr, 6.55k op/s 2026-02-18T03:19:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:58 trial114 ceph-mon[23907]: pgmap v171: 33 pgs: 33 active+clean; 57 GiB data, 30 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s rd, 91 MiB/s wr, 6.55k op/s 2026-02-18T03:19:59.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:58 trial097 ceph-mon[21799]: pgmap v171: 33 pgs: 33 active+clean; 57 GiB data, 30 GiB used, 2.7 TiB / 2.7 TiB avail; 78 MiB/s rd, 91 MiB/s wr, 6.55k op/s 2026-02-18T03:19:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:19:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:59 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2170747906' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:19:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:19:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:19:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:19:59 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:19:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:19:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:59 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2170747906' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:19:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:19:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:19:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:19:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:19:59 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:20:00.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:20:00.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:59 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2170747906' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:00.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:20:00.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:20:00.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:20:00.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:19:59 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:20:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:00 trial119 ceph-mon[24143]: pgmap v172: 33 pgs: 33 active+clean; 57 GiB data, 30 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 77 MiB/s wr, 5.57k op/s 2026-02-18T03:20:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:00 trial119 ceph-mon[24143]: overall HEALTH_OK 2026-02-18T03:20:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:00 trial114 ceph-mon[23907]: pgmap v172: 33 pgs: 33 active+clean; 57 GiB data, 30 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 77 MiB/s wr, 5.57k op/s 2026-02-18T03:20:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:00 trial114 ceph-mon[23907]: overall HEALTH_OK 2026-02-18T03:20:01.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:00 trial097 ceph-mon[21799]: pgmap v172: 33 pgs: 33 active+clean; 57 GiB data, 30 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 77 MiB/s wr, 5.57k op/s 2026-02-18T03:20:01.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:00 trial097 ceph-mon[21799]: overall HEALTH_OK 2026-02-18T03:20:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:02 trial119 ceph-mon[24143]: pgmap v173: 33 pgs: 33 active+clean; 58 GiB data, 31 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 86 MiB/s wr, 6.18k op/s 2026-02-18T03:20:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:02 trial114 ceph-mon[23907]: pgmap v173: 33 pgs: 33 active+clean; 58 GiB data, 31 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 86 MiB/s wr, 6.18k op/s 2026-02-18T03:20:03.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:02 trial097 ceph-mon[21799]: pgmap v173: 33 pgs: 33 active+clean; 58 GiB data, 31 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 86 MiB/s wr, 6.18k op/s 2026-02-18T03:20:03.492 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:03.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.3M 1.3M 0.0k 13.0M 12.6M 0.0k nvme12n1 2026-02-18T03:20:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 1.3M 1.3M 0.0k 13.3M 13.4M 0.0k nvme12n10 2026-02-18T03:20:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 102.20 1.5M 1.4M 0.0k 14.6M 14.2M 0.0k nvme12n2 2026-02-18T03:20:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.2M 1.3M 0.0k 11.9M 12.9M 0.0k nvme12n3 2026-02-18T03:20:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.40 1.3M 1.3M 0.0k 13.0M 13.2M 0.0k nvme12n4 2026-02-18T03:20:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.2M 1.4M 0.0k 12.1M 13.6M 0.0k nvme12n5 2026-02-18T03:20:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.1M 1.3M 0.0k 10.7M 12.8M 0.0k nvme12n6 2026-02-18T03:20:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.60 1.2M 1.3M 0.0k 12.3M 13.2M 0.0k nvme12n7 2026-02-18T03:20:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.2M 1.3M 0.0k 12.3M 12.5M 0.0k nvme12n8 2026-02-18T03:20:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.2M 1.3M 0.0k 12.1M 12.5M 0.0k nvme12n9 2026-02-18T03:20:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 1.3M 1.3M 0.0k 12.8M 12.8M 0.0k nvme4n1 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.2M 1.4M 0.0k 12.2M 13.6M 0.0k nvme4n10 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 1.3M 1.3M 0.0k 12.7M 13.0M 0.0k nvme4n2 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 99.90 1.4M 1.3M 0.0k 13.9M 13.4M 0.0k nvme4n3 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.60 1.4M 1.4M 0.0k 13.6M 13.9M 0.0k nvme4n4 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 1.2M 1.4M 0.0k 12.5M 13.7M 0.0k nvme4n5 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 1.3M 1.3M 0.0k 12.9M 12.8M 0.0k nvme4n6 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.3M 1.2M 0.0k 12.8M 12.4M 0.0k nvme4n7 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 98.80 1.2M 1.3M 0.0k 12.3M 13.1M 0.0k nvme4n8 2026-02-18T03:20:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.3M 1.2M 0.0k 12.5M 12.2M 0.0k nvme4n9 2026-02-18T03:20:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.2M 1.2M 0.0k 12.4M 11.8M 0.0k nvme8n1 2026-02-18T03:20:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 99.30 1.4M 1.3M 0.0k 14.1M 12.9M 0.0k nvme8n10 2026-02-18T03:20:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 96.20 1.4M 1.3M 0.0k 13.5M 12.9M 0.0k nvme8n2 2026-02-18T03:20:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 97.90 1.4M 1.4M 0.0k 13.6M 13.5M 0.0k nvme8n3 2026-02-18T03:20:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.2M 1.3M 0.0k 12.4M 13.1M 0.0k nvme8n4 2026-02-18T03:20:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1.4M 1.2M 0.0k 13.5M 12.1M 0.0k nvme8n5 2026-02-18T03:20:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.3M 1.2M 0.0k 13.1M 11.8M 0.0k nvme8n6 2026-02-18T03:20:03.504 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 1.3M 1.4M 0.0k 12.6M 14.2M 0.0k nvme8n7 2026-02-18T03:20:03.504 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.4M 1.3M 0.0k 13.5M 13.2M 0.0k nvme8n8 2026-02-18T03:20:03.504 INFO:tasks.workunit.client.0.trial031.stdout: 98.40 1.3M 1.4M 0.0k 13.2M 13.8M 0.0k nvme8n9 2026-02-18T03:20:03.504 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:03 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1528808665' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:03 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1710715129' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:03 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3613261271' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:03 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1528808665' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:03 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1710715129' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:03 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3613261271' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:03.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1.3M 1.2M 0.0k 13.0M 12.5M 0.0k nvme12n11 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 99.70 1.4M 1.4M 0.0k 14.2M 14.0M 0.0k nvme12n12 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.3M 1.4M 0.0k 12.6M 13.8M 0.0k nvme12n13 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 97.80 1.4M 1.4M 0.0k 13.6M 13.7M 0.0k nvme12n14 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1.1M 1.3M 0.0k 11.2M 13.1M 0.0k nvme12n15 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 1.1M 1.3M 0.0k 11.4M 13.3M 0.0k nvme12n16 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1.2M 1.2M 0.0k 12.2M 12.5M 0.0k nvme12n17 2026-02-18T03:20:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.3M 1.3M 0.0k 13.0M 12.6M 0.0k nvme12n18 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.2M 1.3M 0.0k 12.2M 13.2M 0.0k nvme12n19 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.00 1.2M 1.3M 0.0k 12.4M 13.5M 0.0k nvme12n20 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.3M 1.2M 0.0k 12.8M 12.1M 0.0k nvme4n11 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.2M 1.4M 0.0k 12.0M 13.6M 0.0k nvme4n12 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.2M 1.3M 0.0k 11.8M 13.1M 0.0k nvme4n13 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 99.60 1.4M 1.4M 0.0k 14.5M 14.4M 0.0k nvme4n14 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.2M 1.3M 0.0k 12.0M 13.1M 0.0k nvme4n15 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.70 1.3M 1.3M 0.0k 13.1M 13.2M 0.0k nvme4n16 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 1.3M 1.3M 0.0k 13.0M 13.3M 0.0k nvme4n17 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 1.2M 1.3M 0.0k 12.3M 12.6M 0.0k nvme4n18 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 104.00 1.4M 1.4M 0.0k 14.3M 14.0M 0.0k nvme4n19 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.3M 1.3M 0.0k 12.6M 12.8M 0.0k nvme4n20 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 99.90 1.3M 1.3M 0.0k 13.2M 12.8M 0.0k nvme8n11 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 101.60 1.4M 1.3M 0.0k 13.8M 13.4M 0.0k nvme8n12 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.2M 1.4M 0.0k 12.2M 13.7M 0.0k nvme8n13 2026-02-18T03:20:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.2M 1.3M 0.0k 12.3M 12.8M 0.0k nvme8n14 2026-02-18T03:20:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 104.30 1.5M 1.4M 0.0k 15.3M 13.5M 0.0k nvme8n15 2026-02-18T03:20:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.3M 1.3M 0.0k 12.9M 12.5M 0.0k nvme8n16 2026-02-18T03:20:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.2M 1.4M 0.0k 12.5M 14.2M 0.0k nvme8n17 2026-02-18T03:20:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.3M 1.3M 0.0k 13.2M 13.2M 0.0k nvme8n18 2026-02-18T03:20:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 1.3M 1.4M 0.0k 12.6M 13.6M 0.0k nvme8n19 2026-02-18T03:20:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.50 1.3M 1.2M 0.0k 13.5M 12.3M 0.0k nvme8n20 2026-02-18T03:20:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:04.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:03 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1528808665' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:04.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:03 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1710715129' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:04.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:03 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3613261271' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:04 trial119 ceph-mon[24143]: pgmap v174: 33 pgs: 33 active+clean; 58 GiB data, 32 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 77 MiB/s wr, 5.58k op/s 2026-02-18T03:20:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:04 trial114 ceph-mon[23907]: pgmap v174: 33 pgs: 33 active+clean; 58 GiB data, 32 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 77 MiB/s wr, 5.58k op/s 2026-02-18T03:20:05.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:04 trial097 ceph-mon[21799]: pgmap v174: 33 pgs: 33 active+clean; 58 GiB data, 32 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 77 MiB/s wr, 5.58k op/s 2026-02-18T03:20:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:06 trial119 ceph-mon[24143]: pgmap v175: 33 pgs: 33 active+clean; 58 GiB data, 32 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 82 MiB/s wr, 5.93k op/s 2026-02-18T03:20:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:06 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/67804851' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:06 trial114 ceph-mon[23907]: pgmap v175: 33 pgs: 33 active+clean; 58 GiB data, 32 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 82 MiB/s wr, 5.93k op/s 2026-02-18T03:20:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:06 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/67804851' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:07.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:06 trial097 ceph-mon[21799]: pgmap v175: 33 pgs: 33 active+clean; 58 GiB data, 32 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 82 MiB/s wr, 5.93k op/s 2026-02-18T03:20:07.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:06 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/67804851' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:08 trial119 ceph-mon[24143]: pgmap v176: 33 pgs: 33 active+clean; 58 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 85 MiB/s wr, 6.20k op/s 2026-02-18T03:20:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:08 trial114 ceph-mon[23907]: pgmap v176: 33 pgs: 33 active+clean; 58 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 85 MiB/s wr, 6.20k op/s 2026-02-18T03:20:09.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:08 trial097 ceph-mon[21799]: pgmap v176: 33 pgs: 33 active+clean; 58 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 85 MiB/s wr, 6.20k op/s 2026-02-18T03:20:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:10 trial119 ceph-mon[24143]: pgmap v177: 33 pgs: 33 active+clean; 58 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 72 MiB/s wr, 5.32k op/s 2026-02-18T03:20:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:10 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2736550123' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:10.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:10 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/538412424' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:10.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:10 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/294823875' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:10 trial114 ceph-mon[23907]: pgmap v177: 33 pgs: 33 active+clean; 58 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 72 MiB/s wr, 5.32k op/s 2026-02-18T03:20:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:10 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2736550123' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:10 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/538412424' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:10.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:10 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/294823875' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:11.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:10 trial097 ceph-mon[21799]: pgmap v177: 33 pgs: 33 active+clean; 58 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 72 MiB/s wr, 5.32k op/s 2026-02-18T03:20:11.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:10 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2736550123' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:11.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:10 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/538412424' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:11.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:10 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/294823875' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:12 trial119 ceph-mon[24143]: pgmap v178: 33 pgs: 33 active+clean; 58 GiB data, 34 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 81 MiB/s wr, 5.99k op/s 2026-02-18T03:20:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:12 trial114 ceph-mon[23907]: pgmap v178: 33 pgs: 33 active+clean; 58 GiB data, 34 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 81 MiB/s wr, 5.99k op/s 2026-02-18T03:20:13.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:12 trial097 ceph-mon[21799]: pgmap v178: 33 pgs: 33 active+clean; 58 GiB data, 34 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 81 MiB/s wr, 5.99k op/s 2026-02-18T03:20:13.492 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:13.494 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:13.494 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.3M 1.3M 0.0k 13.2M 13.4M 0.0k nvme12n1 2026-02-18T03:20:13.494 INFO:tasks.workunit.client.0.trial031.stdout: 96.50 1.3M 1.3M 0.0k 12.7M 13.3M 0.0k nvme12n10 2026-02-18T03:20:13.494 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 1.2M 1.2M 0.0k 12.0M 11.7M 0.0k nvme12n2 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 101.50 1.4M 1.3M 0.0k 14.2M 12.7M 0.0k nvme12n3 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 1.2M 1.3M 0.0k 12.2M 13.3M 0.0k nvme12n4 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1.3M 1.3M 0.0k 13.1M 12.7M 0.0k nvme12n5 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.3M 1.2M 0.0k 12.9M 12.1M 0.0k nvme12n6 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 1.2M 1.4M 0.0k 12.2M 14.0M 0.0k nvme12n7 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.3M 1.3M 0.0k 13.0M 13.2M 0.0k nvme12n8 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 1.3M 1.2M 0.0k 12.6M 12.0M 0.0k nvme12n9 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.2M 1.3M 0.0k 11.6M 12.8M 0.0k nvme4n1 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.2M 1.2M 0.0k 11.7M 12.2M 0.0k nvme4n10 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.1M 1.3M 0.0k 11.1M 12.8M 0.0k nvme4n2 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 95.60 1.2M 1.3M 0.0k 12.2M 12.9M 0.0k nvme4n3 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 95.20 1.4M 1.3M 0.0k 14.2M 12.6M 0.0k nvme4n4 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 97.20 1.3M 1.3M 0.0k 12.9M 13.3M 0.0k nvme4n5 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.2M 1.2M 0.0k 11.7M 12.0M 0.0k nvme4n6 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.4M 1.2M 0.0k 13.5M 11.6M 0.0k nvme4n7 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 86.90 1.2M 1.2M 0.0k 11.6M 12.1M 0.0k nvme4n8 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 99.70 1.4M 1.3M 0.0k 14.1M 12.7M 0.0k nvme4n9 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.2M 1.3M 0.0k 11.6M 12.5M 0.0k nvme8n1 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 97.50 1.3M 1.4M 0.0k 12.8M 14.2M 0.0k nvme8n10 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 97.10 1.3M 1.2M 0.0k 13.4M 11.8M 0.0k nvme8n2 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 99.90 1.3M 1.5M 0.0k 13.3M 14.6M 0.0k nvme8n3 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 1.2M 1.2M 0.0k 12.2M 12.2M 0.0k nvme8n4 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 1.4M 1.2M 0.0k 14.2M 12.5M 0.0k nvme8n5 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.2M 1.3M 0.0k 12.5M 13.2M 0.0k nvme8n6 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.3M 1.4M 0.0k 12.8M 13.8M 0.0k nvme8n7 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 98.60 1.4M 1.3M 0.0k 13.7M 13.1M 0.0k nvme8n8 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 98.60 1.3M 1.3M 0.0k 13.0M 13.2M 0.0k nvme8n9 2026-02-18T03:20:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:13.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3896535090' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:13.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3896535090' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:13.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:13.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.3M 1.3M 0.0k 13.2M 12.6M 0.0k nvme12n11 2026-02-18T03:20:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.3M 1.2M 0.0k 12.8M 12.4M 0.0k nvme12n12 2026-02-18T03:20:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.60 1.4M 1.2M 0.0k 13.8M 12.4M 0.0k nvme12n13 2026-02-18T03:20:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 100.00 1.3M 1.4M 0.0k 13.1M 14.1M 0.0k nvme12n14 2026-02-18T03:20:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.4M 1.3M 0.0k 14.3M 13.0M 0.0k nvme12n15 2026-02-18T03:20:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.30 1.3M 1.3M 0.0k 13.2M 13.4M 0.0k nvme12n16 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.70 1.1M 1.3M 0.0k 10.9M 13.2M 0.0k nvme12n17 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 1.2M 1.3M 0.0k 12.4M 12.7M 0.0k nvme12n18 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1.2M 1.3M 0.0k 12.0M 12.7M 0.0k nvme12n19 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.3M 1.3M 0.0k 13.0M 12.9M 0.0k nvme12n20 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.20 1.2M 1.4M 0.0k 12.2M 13.7M 0.0k nvme4n11 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 1.4M 1.3M 0.0k 13.8M 12.6M 0.0k nvme4n12 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.2M 1.2M 0.0k 12.4M 12.2M 0.0k nvme4n13 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 1.4M 1.3M 0.0k 13.8M 12.6M 0.0k nvme4n14 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 1.2M 1.2M 0.0k 11.6M 12.3M 0.0k nvme4n15 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.3M 1.3M 0.0k 13.1M 12.8M 0.0k nvme4n16 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 1.4M 1.1M 0.0k 14.2M 11.4M 0.0k nvme4n17 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.50 1.3M 1.3M 0.0k 12.9M 13.0M 0.0k nvme4n18 2026-02-18T03:20:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 101.50 1.5M 1.3M 0.0k 14.6M 13.4M 0.0k nvme4n19 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.2M 1.3M 0.0k 12.5M 13.4M 0.0k nvme4n20 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.50 1.3M 1.3M 0.0k 12.6M 13.5M 0.0k nvme8n11 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 102.60 1.3M 1.3M 0.0k 13.4M 12.5M 0.0k nvme8n12 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.2M 1.2M 0.0k 12.4M 11.8M 0.0k nvme8n13 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.2M 1.3M 0.0k 11.9M 13.3M 0.0k nvme8n14 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 102.40 1.4M 1.3M 0.0k 14.4M 12.9M 0.0k nvme8n15 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.3M 1.3M 0.0k 13.0M 13.2M 0.0k nvme8n16 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 101.90 1.4M 1.5M 0.0k 13.7M 14.9M 0.0k nvme8n17 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 99.30 1.4M 1.3M 0.0k 13.9M 13.4M 0.0k nvme8n18 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 83.80 1.1M 1.2M 0.0k 11.2M 11.8M 0.0k nvme8n19 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.2M 1.3M 0.0k 11.9M 13.2M 0.0k nvme8n20 2026-02-18T03:20:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:14.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3896535090' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:14 trial119 ceph-mon[24143]: pgmap v179: 33 pgs: 33 active+clean; 58 GiB data, 34 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 74 MiB/s wr, 5.49k op/s 2026-02-18T03:20:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:14 trial114 ceph-mon[23907]: pgmap v179: 33 pgs: 33 active+clean; 58 GiB data, 34 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 74 MiB/s wr, 5.49k op/s 2026-02-18T03:20:15.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:14 trial097 ceph-mon[21799]: pgmap v179: 33 pgs: 33 active+clean; 58 GiB data, 34 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 74 MiB/s wr, 5.49k op/s 2026-02-18T03:20:16.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:16 trial119 ceph-mon[24143]: pgmap v180: 33 pgs: 33 active+clean; 58 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 79 MiB/s wr, 5.85k op/s 2026-02-18T03:20:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:16 trial114 ceph-mon[23907]: pgmap v180: 33 pgs: 33 active+clean; 58 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 79 MiB/s wr, 5.85k op/s 2026-02-18T03:20:17.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:16 trial097 ceph-mon[21799]: pgmap v180: 33 pgs: 33 active+clean; 58 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 79 MiB/s wr, 5.85k op/s 2026-02-18T03:20:17.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:17 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2337586844' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:17.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:17 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1275980127' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:17.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:17 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3756015356' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:17.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:17 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2337586844' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:17.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:17 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1275980127' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:17.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:17 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3756015356' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:18.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:17 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2337586844' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:18.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:17 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1275980127' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:18.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:17 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3756015356' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:18 trial119 ceph-mon[24143]: pgmap v181: 33 pgs: 33 active+clean; 58 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 83 MiB/s wr, 6.15k op/s 2026-02-18T03:20:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:18 trial114 ceph-mon[23907]: pgmap v181: 33 pgs: 33 active+clean; 58 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 83 MiB/s wr, 6.15k op/s 2026-02-18T03:20:19.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:18 trial097 ceph-mon[21799]: pgmap v181: 33 pgs: 33 active+clean; 58 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 73 MiB/s rd, 83 MiB/s wr, 6.15k op/s 2026-02-18T03:20:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:20 trial119 ceph-mon[24143]: pgmap v182: 33 pgs: 33 active+clean; 58 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 71 MiB/s wr, 5.31k op/s 2026-02-18T03:20:20.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:20 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/982149391' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:20 trial114 ceph-mon[23907]: pgmap v182: 33 pgs: 33 active+clean; 58 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 71 MiB/s wr, 5.31k op/s 2026-02-18T03:20:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:20 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/982149391' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:21.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:20 trial097 ceph-mon[21799]: pgmap v182: 33 pgs: 33 active+clean; 58 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 71 MiB/s wr, 5.31k op/s 2026-02-18T03:20:21.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:20 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/982149391' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:22.956 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:22 trial097 ceph-mon[21799]: pgmap v183: 33 pgs: 33 active+clean; 58 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 80 MiB/s wr, 5.96k op/s 2026-02-18T03:20:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:22 trial119 ceph-mon[24143]: pgmap v183: 33 pgs: 33 active+clean; 58 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 80 MiB/s wr, 5.96k op/s 2026-02-18T03:20:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:22 trial114 ceph-mon[23907]: pgmap v183: 33 pgs: 33 active+clean; 58 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 80 MiB/s wr, 5.96k op/s 2026-02-18T03:20:23.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:23.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.3M 1.2M 0.0k 13.4M 12.0M 0.0k nvme12n1 2026-02-18T03:20:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.1M 1.2M 0.0k 11.5M 12.0M 0.0k nvme12n10 2026-02-18T03:20:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 1.3M 1.2M 0.0k 13.4M 12.4M 0.0k nvme12n2 2026-02-18T03:20:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 97.10 1.4M 1.3M 0.0k 13.6M 12.7M 0.0k nvme12n3 2026-02-18T03:20:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.2M 1.2M 0.0k 11.8M 11.9M 0.0k nvme12n4 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 1.2M 1.2M 0.0k 12.4M 12.1M 0.0k nvme12n5 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.2M 1.2M 0.0k 11.9M 12.2M 0.0k nvme12n6 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 1.2M 1.3M 0.0k 11.6M 12.8M 0.0k nvme12n7 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 102.30 1.5M 1.3M 0.0k 14.7M 13.0M 0.0k nvme12n8 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 1.3M 1.2M 0.0k 12.8M 12.4M 0.0k nvme12n9 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.2M 1.2M 0.0k 11.6M 12.5M 0.0k nvme4n1 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 1.2M 1.2M 0.0k 11.6M 12.2M 0.0k nvme4n10 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.4M 1.2M 0.0k 14.0M 12.3M 0.0k nvme4n2 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 1.3M 1.3M 0.0k 13.3M 13.2M 0.0k nvme4n3 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 95.60 1.2M 1.3M 0.0k 11.9M 13.2M 0.0k nvme4n4 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.2M 1.2M 0.0k 11.6M 12.3M 0.0k nvme4n5 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.3M 1.2M 0.0k 12.5M 12.2M 0.0k nvme4n6 2026-02-18T03:20:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.3M 1.2M 0.0k 12.7M 12.2M 0.0k nvme4n7 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.2M 1.3M 0.0k 11.9M 12.7M 0.0k nvme4n8 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 1.1M 1.2M 0.0k 11.0M 11.6M 0.0k nvme4n9 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.5M 1.3M 0.0k 14.6M 12.9M 0.0k nvme8n1 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 1.2M 1.1M 0.0k 12.5M 11.5M 0.0k nvme8n10 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.70 1.2M 1.3M 0.0k 12.3M 13.1M 0.0k nvme8n2 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 1.2M 1.3M 0.0k 12.2M 13.0M 0.0k nvme8n3 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.3M 1.3M 0.0k 12.7M 12.6M 0.0k nvme8n4 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.90 1.4M 1.2M 0.0k 13.5M 12.4M 0.0k nvme8n5 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.20 1.2M 1.3M 0.0k 11.6M 13.0M 0.0k nvme8n6 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.2M 1.3M 0.0k 11.5M 13.2M 0.0k nvme8n7 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.50 1.2M 1.3M 0.0k 12.5M 12.7M 0.0k nvme8n8 2026-02-18T03:20:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.60 1.2M 1.3M 0.0k 11.6M 13.0M 0.0k nvme8n9 2026-02-18T03:20:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:23.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.4M 1.3M 0.0k 13.7M 13.1M 0.0k nvme12n11 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.4M 1.2M 0.0k 13.5M 12.0M 0.0k nvme12n12 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.00 1.3M 1.2M 0.0k 13.3M 12.3M 0.0k nvme12n13 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 1.2M 1.2M 0.0k 11.9M 12.3M 0.0k nvme12n14 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.3M 1.3M 0.0k 12.8M 12.8M 0.0k nvme12n15 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 1.2M 1.2M 0.0k 11.9M 12.1M 0.0k nvme12n16 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.2M 1.3M 0.0k 12.3M 13.0M 0.0k nvme12n17 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1.3M 1.3M 0.0k 12.6M 12.9M 0.0k nvme12n18 2026-02-18T03:20:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 1.4M 1.2M 0.0k 13.6M 12.1M 0.0k nvme12n19 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.2M 1.2M 0.0k 12.3M 12.2M 0.0k nvme12n20 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.2M 1.3M 0.0k 12.1M 12.5M 0.0k nvme4n11 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 1.3M 1.3M 0.0k 13.2M 13.4M 0.0k nvme4n12 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1.2M 1.2M 0.0k 12.2M 12.3M 0.0k nvme4n13 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.2M 1.3M 0.0k 12.4M 13.4M 0.0k nvme4n14 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.2M 1.2M 0.0k 11.7M 12.4M 0.0k nvme4n15 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.30 1.4M 1.3M 0.0k 13.7M 13.2M 0.0k nvme4n16 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.2M 1.2M 0.0k 12.3M 11.6M 0.0k nvme4n17 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.2M 1.3M 0.0k 12.0M 12.7M 0.0k nvme4n18 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.2M 1.2M 0.0k 11.5M 12.1M 0.0k nvme4n19 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.2M 1.3M 0.0k 11.7M 13.0M 0.0k nvme4n20 2026-02-18T03:20:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 101.90 1.5M 1.4M 0.0k 15.1M 13.5M 0.0k nvme8n11 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.90 1.3M 1.4M 0.0k 12.6M 13.7M 0.0k nvme8n12 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 99.80 1.3M 1.4M 0.0k 13.1M 13.8M 0.0k nvme8n13 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.3M 1.2M 0.0k 12.9M 12.4M 0.0k nvme8n14 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.20 1.4M 1.3M 0.0k 14.4M 12.9M 0.0k nvme8n15 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.80 1.3M 1.4M 0.0k 13.2M 13.8M 0.0k nvme8n16 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.80 1.2M 1.3M 0.0k 11.7M 13.5M 0.0k nvme8n17 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 101.40 1.3M 1.2M 0.0k 13.1M 12.4M 0.0k nvme8n18 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 1.3M 1.2M 0.0k 12.7M 12.4M 0.0k nvme8n19 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.3M 1.2M 0.0k 12.9M 12.2M 0.0k nvme8n20 2026-02-18T03:20:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:24 trial119 ceph-mon[24143]: pgmap v184: 33 pgs: 33 active+clean; 58 GiB data, 37 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 73 MiB/s wr, 5.44k op/s 2026-02-18T03:20:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1453011298' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2451031799' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:24.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3345913458' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:24 trial114 ceph-mon[23907]: pgmap v184: 33 pgs: 33 active+clean; 58 GiB data, 37 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 73 MiB/s wr, 5.44k op/s 2026-02-18T03:20:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1453011298' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2451031799' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3345913458' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:25.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:24 trial097 ceph-mon[21799]: pgmap v184: 33 pgs: 33 active+clean; 58 GiB data, 37 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 73 MiB/s wr, 5.44k op/s 2026-02-18T03:20:25.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1453011298' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:25.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2451031799' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:25.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3345913458' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:26.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:25 trial097 ceph-mon[21799]: pgmap v185: 33 pgs: 33 active+clean; 58 GiB data, 37 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 77 MiB/s wr, 5.81k op/s 2026-02-18T03:20:26.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:25 trial119 ceph-mon[24143]: pgmap v185: 33 pgs: 33 active+clean; 58 GiB data, 37 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 77 MiB/s wr, 5.81k op/s 2026-02-18T03:20:26.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:25 trial114 ceph-mon[23907]: pgmap v185: 33 pgs: 33 active+clean; 58 GiB data, 37 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 77 MiB/s wr, 5.81k op/s 2026-02-18T03:20:27.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:27 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/616392837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:27.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:27 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/616392837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:27.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:27 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/616392837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:28.655 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:28 trial097 ceph-mon[21799]: pgmap v186: 33 pgs: 33 active+clean; 58 GiB data, 38 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 81 MiB/s wr, 6.14k op/s 2026-02-18T03:20:28.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:28 trial119 ceph-mon[24143]: pgmap v186: 33 pgs: 33 active+clean; 58 GiB data, 38 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 81 MiB/s wr, 6.14k op/s 2026-02-18T03:20:28.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:28 trial114 ceph-mon[23907]: pgmap v186: 33 pgs: 33 active+clean; 58 GiB data, 38 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 81 MiB/s wr, 6.14k op/s 2026-02-18T03:20:30.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:30 trial097 ceph-mon[21799]: pgmap v187: 33 pgs: 33 active+clean; 58 GiB data, 38 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 70 MiB/s wr, 5.32k op/s 2026-02-18T03:20:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:30 trial119 ceph-mon[24143]: pgmap v187: 33 pgs: 33 active+clean; 58 GiB data, 38 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 70 MiB/s wr, 5.32k op/s 2026-02-18T03:20:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:30 trial114 ceph-mon[23907]: pgmap v187: 33 pgs: 33 active+clean; 58 GiB data, 38 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 70 MiB/s wr, 5.32k op/s 2026-02-18T03:20:31.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:31 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1321629982' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:31.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:31 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3246125422' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:31.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:31 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/884871409' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:31.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:31 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1321629982' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:31.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:31 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3246125422' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:31.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:31 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/884871409' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:31.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:31 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1321629982' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:31.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:31 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3246125422' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:31.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:31 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/884871409' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:32.874 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:32 trial114 ceph-mon[23907]: pgmap v188: 33 pgs: 33 active+clean; 58 GiB data, 39 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 79 MiB/s wr, 6.03k op/s 2026-02-18T03:20:32.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:32 trial097 ceph-mon[21799]: pgmap v188: 33 pgs: 33 active+clean; 58 GiB data, 39 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 79 MiB/s wr, 6.03k op/s 2026-02-18T03:20:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:32 trial119 ceph-mon[24143]: pgmap v188: 33 pgs: 33 active+clean; 58 GiB data, 39 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s rd, 79 MiB/s wr, 6.03k op/s 2026-02-18T03:20:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:33.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.3M 1.2M 0.0k 12.8M 12.5M 0.0k nvme12n1 2026-02-18T03:20:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.2M 1.2M 0.0k 12.2M 12.2M 0.0k nvme12n10 2026-02-18T03:20:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 101.20 1.3M 1.3M 0.0k 13.3M 12.7M 0.0k nvme12n2 2026-02-18T03:20:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.1M 1.2M 0.0k 11.4M 11.9M 0.0k nvme12n3 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 1.1M 1.1M 0.0k 10.7M 11.4M 0.0k nvme12n4 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.2M 1.3M 0.0k 11.8M 13.1M 0.0k nvme12n5 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 105.30 1.4M 1.3M 0.0k 13.7M 13.3M 0.0k nvme12n6 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.00 1.4M 1.3M 0.0k 13.7M 12.6M 0.0k nvme12n7 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.50 1.3M 1.2M 0.0k 12.7M 12.3M 0.0k nvme12n8 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 1.3M 1.3M 0.0k 12.7M 13.2M 0.0k nvme12n9 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.3M 1.2M 0.0k 12.8M 12.0M 0.0k nvme4n1 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1.3M 1.2M 0.0k 12.9M 12.0M 0.0k nvme4n10 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.70 1.3M 1.2M 0.0k 13.3M 12.2M 0.0k nvme4n2 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.2M 1.3M 0.0k 12.4M 12.7M 0.0k nvme4n3 2026-02-18T03:20:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.80 1.4M 1.2M 0.0k 13.7M 12.1M 0.0k nvme4n4 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1.2M 1.2M 0.0k 11.6M 12.3M 0.0k nvme4n5 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.3M 1.2M 0.0k 12.6M 12.3M 0.0k nvme4n6 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.2M 1.3M 0.0k 12.5M 12.9M 0.0k nvme4n7 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.2M 1.2M 0.0k 12.2M 12.2M 0.0k nvme4n8 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.3M 1.2M 0.0k 12.6M 12.1M 0.0k nvme4n9 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1.2M 1.2M 0.0k 12.1M 12.3M 0.0k nvme8n1 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 1.1M 1.3M 0.0k 11.3M 12.6M 0.0k nvme8n10 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.1M 1.2M 0.0k 10.9M 11.6M 0.0k nvme8n2 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 97.30 1.3M 1.2M 0.0k 13.2M 12.3M 0.0k nvme8n3 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 1.3M 1.1M 0.0k 13.4M 11.5M 0.0k nvme8n4 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 1.3M 1.3M 0.0k 12.8M 13.0M 0.0k nvme8n5 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 99.50 1.3M 1.2M 0.0k 12.6M 12.1M 0.0k nvme8n6 2026-02-18T03:20:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 98.00 1.2M 1.3M 0.0k 12.4M 12.7M 0.0k nvme8n7 2026-02-18T03:20:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 1.4M 1.2M 0.0k 13.6M 12.4M 0.0k nvme8n8 2026-02-18T03:20:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.2M 1.2M 0.0k 12.5M 12.4M 0.0k nvme8n9 2026-02-18T03:20:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:33.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.80 1.2M 1.2M 0.0k 12.5M 12.1M 0.0k nvme12n11 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 1.2M 1.2M 0.0k 12.1M 12.1M 0.0k nvme12n12 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.1M 1.2M 0.0k 11.3M 11.8M 0.0k nvme12n13 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.80 1.3M 1.3M 0.0k 13.1M 12.9M 0.0k nvme12n14 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1.1M 1.3M 0.0k 11.5M 12.7M 0.0k nvme12n15 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 101.00 1.3M 1.3M 0.0k 13.2M 12.7M 0.0k nvme12n16 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.1M 1.2M 0.0k 10.9M 12.0M 0.0k nvme12n17 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.3M 1.2M 0.0k 13.2M 12.0M 0.0k nvme12n18 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 1.2M 1.3M 0.0k 12.3M 12.7M 0.0k nvme12n19 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.2M 1.3M 0.0k 12.0M 13.3M 0.0k nvme12n20 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 105.00 1.4M 1.3M 0.0k 13.9M 13.3M 0.0k nvme4n11 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 102.30 1.4M 1.2M 0.0k 13.9M 12.5M 0.0k nvme4n12 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 1.3M 1.3M 0.0k 12.8M 12.9M 0.0k nvme4n13 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 103.00 1.4M 1.3M 0.0k 14.3M 12.9M 0.0k nvme4n14 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 100.80 1.3M 1.4M 0.0k 13.0M 13.6M 0.0k nvme4n15 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 1.3M 1.2M 0.0k 13.3M 12.4M 0.0k nvme4n16 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.80 1.2M 1.3M 0.0k 12.3M 12.9M 0.0k nvme4n17 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 1.2M 1.3M 0.0k 12.4M 13.0M 0.0k nvme4n18 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.60 1.4M 1.3M 0.0k 13.6M 12.6M 0.0k nvme4n19 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1.2M 1.2M 0.0k 11.7M 12.3M 0.0k nvme4n20 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.90 1.3M 1.3M 0.0k 13.1M 13.2M 0.0k nvme8n11 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 102.80 1.3M 1.2M 0.0k 13.4M 12.5M 0.0k nvme8n12 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 87.30 1.2M 1.2M 0.0k 11.5M 11.8M 0.0k nvme8n13 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 1.4M 1.2M 0.0k 13.9M 11.8M 0.0k nvme8n14 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.80 1.3M 1.3M 0.0k 12.6M 13.3M 0.0k nvme8n15 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 1.1M 1.1M 0.0k 11.3M 11.3M 0.0k nvme8n16 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.80 1.2M 1.3M 0.0k 12.4M 12.5M 0.0k nvme8n17 2026-02-18T03:20:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 1.3M 1.4M 0.0k 13.0M 13.7M 0.0k nvme8n18 2026-02-18T03:20:33.978 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 1.1M 1.3M 0.0k 11.4M 13.3M 0.0k nvme8n19 2026-02-18T03:20:33.978 INFO:tasks.workunit.client.1.trial078.stdout: 87.50 1.0M 1.2M 0.0k 10.4M 11.8M 0.0k nvme8n20 2026-02-18T03:20:33.978 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:34.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:34 trial097 ceph-mon[21799]: pgmap v189: 33 pgs: 33 active+clean; 58 GiB data, 39 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 72 MiB/s wr, 5.52k op/s 2026-02-18T03:20:34.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:34 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2110019969' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:34 trial119 ceph-mon[24143]: pgmap v189: 33 pgs: 33 active+clean; 58 GiB data, 39 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 72 MiB/s wr, 5.52k op/s 2026-02-18T03:20:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:34 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2110019969' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:34 trial114 ceph-mon[23907]: pgmap v189: 33 pgs: 33 active+clean; 58 GiB data, 39 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 72 MiB/s wr, 5.52k op/s 2026-02-18T03:20:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:34 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2110019969' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:36.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:36 trial097 ceph-mon[21799]: pgmap v190: 33 pgs: 33 active+clean; 58 GiB data, 40 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 76 MiB/s wr, 5.89k op/s 2026-02-18T03:20:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:36 trial119 ceph-mon[24143]: pgmap v190: 33 pgs: 33 active+clean; 58 GiB data, 40 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 76 MiB/s wr, 5.89k op/s 2026-02-18T03:20:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:36 trial114 ceph-mon[23907]: pgmap v190: 33 pgs: 33 active+clean; 58 GiB data, 40 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 76 MiB/s wr, 5.89k op/s 2026-02-18T03:20:38.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:38 trial097 ceph-mon[21799]: pgmap v191: 33 pgs: 33 active+clean; 58 GiB data, 40 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 80 MiB/s wr, 6.18k op/s 2026-02-18T03:20:38.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:38 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/991972456' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:38.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:38 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/873887039' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:38.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:38 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3149331083' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:38 trial119 ceph-mon[24143]: pgmap v191: 33 pgs: 33 active+clean; 58 GiB data, 40 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 80 MiB/s wr, 6.18k op/s 2026-02-18T03:20:38.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:38 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/991972456' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:38.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:38 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/873887039' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:38.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:38 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3149331083' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:38 trial114 ceph-mon[23907]: pgmap v191: 33 pgs: 33 active+clean; 58 GiB data, 40 GiB used, 2.7 TiB / 2.7 TiB avail; 72 MiB/s rd, 80 MiB/s wr, 6.18k op/s 2026-02-18T03:20:38.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:38 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/991972456' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:38.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:38 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/873887039' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:38.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:38 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3149331083' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:40.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:40 trial097 ceph-mon[21799]: pgmap v192: 33 pgs: 33 active+clean; 58 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 69 MiB/s wr, 5.33k op/s 2026-02-18T03:20:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:40 trial119 ceph-mon[24143]: pgmap v192: 33 pgs: 33 active+clean; 58 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 69 MiB/s wr, 5.33k op/s 2026-02-18T03:20:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:40 trial114 ceph-mon[23907]: pgmap v192: 33 pgs: 33 active+clean; 58 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 69 MiB/s wr, 5.33k op/s 2026-02-18T03:20:41.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/4061718076' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:41.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/4061718076' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:41.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/4061718076' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:42.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:42 trial097 ceph-mon[21799]: pgmap v193: 33 pgs: 33 active+clean; 58 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 78 MiB/s wr, 6.01k op/s 2026-02-18T03:20:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:42 trial119 ceph-mon[24143]: pgmap v193: 33 pgs: 33 active+clean; 58 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 78 MiB/s wr, 6.01k op/s 2026-02-18T03:20:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:42 trial114 ceph-mon[23907]: pgmap v193: 33 pgs: 33 active+clean; 58 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 78 MiB/s wr, 6.01k op/s 2026-02-18T03:20:43.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 1.1M 1.2M 0.0k 11.2M 12.1M 0.0k nvme12n1 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.1M 1.2M 0.0k 11.3M 12.2M 0.0k nvme12n10 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 97.10 1.2M 1.3M 0.0k 12.0M 13.4M 0.0k nvme12n2 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.2M 1.2M 0.0k 12.5M 12.2M 0.0k nvme12n3 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 98.10 1.3M 1.3M 0.0k 13.3M 12.7M 0.0k nvme12n4 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 1.2M 1.2M 0.0k 11.9M 11.7M 0.0k nvme12n5 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 85.30 1014.8k 1.2M 0.0k 9.9M 11.8M 0.0k nvme12n6 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 101.50 1.3M 1.4M 0.0k 12.6M 13.7M 0.0k nvme12n7 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.2M 1.1M 0.0k 12.1M 11.4M 0.0k nvme12n8 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 1.2M 1.2M 0.0k 12.0M 12.4M 0.0k nvme12n9 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.2M 1.2M 0.0k 12.0M 12.2M 0.0k nvme4n1 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.3M 1.2M 0.0k 12.8M 12.5M 0.0k nvme4n10 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.2M 1.2M 0.0k 12.2M 11.8M 0.0k nvme4n2 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.1M 1.2M 0.0k 10.6M 12.3M 0.0k nvme4n3 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.1M 1.2M 0.0k 10.7M 12.2M 0.0k nvme4n4 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.2M 1.3M 0.0k 12.2M 12.7M 0.0k nvme4n5 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.3M 1.2M 0.0k 13.4M 11.8M 0.0k nvme4n6 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.1M 1.3M 0.0k 11.2M 12.6M 0.0k nvme4n7 2026-02-18T03:20:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.50 1.2M 1.2M 0.0k 11.7M 11.7M 0.0k nvme4n8 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 84.60 1.1M 1.0M 0.0k 11.2M 10.5M 0.0k nvme4n9 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1.3M 1.3M 0.0k 12.9M 12.6M 0.0k nvme8n1 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 95.20 1.2M 1.2M 0.0k 12.4M 11.8M 0.0k nvme8n10 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 98.40 1.3M 1.3M 0.0k 13.2M 13.4M 0.0k nvme8n2 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 101.70 1.4M 1.2M 0.0k 14.3M 12.4M 0.0k nvme8n3 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.3M 1.2M 0.0k 13.1M 12.3M 0.0k nvme8n4 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.3M 1.2M 0.0k 12.8M 12.4M 0.0k nvme8n5 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 84.70 1.0M 1.2M 0.0k 10.3M 11.7M 0.0k nvme8n6 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.1M 1.2M 0.0k 11.0M 11.8M 0.0k nvme8n7 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 1.1M 1.2M 0.0k 10.8M 11.8M 0.0k nvme8n8 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 102.40 1.3M 1.2M 0.0k 13.3M 12.4M 0.0k nvme8n9 2026-02-18T03:20:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:43.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:43.977 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:43.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 1.2M 1.3M 0.0k 12.4M 12.6M 0.0k nvme12n11 2026-02-18T03:20:43.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 1.2M 1.3M 0.0k 12.1M 12.9M 0.0k nvme12n12 2026-02-18T03:20:43.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 1.2M 1.2M 0.0k 12.2M 12.2M 0.0k nvme12n13 2026-02-18T03:20:43.977 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 1.3M 1.3M 0.0k 12.7M 12.6M 0.0k nvme12n14 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 1.2M 1.1M 0.0k 12.0M 11.4M 0.0k nvme12n15 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.1M 1.3M 0.0k 11.4M 12.8M 0.0k nvme12n16 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.3M 1.2M 0.0k 13.0M 12.1M 0.0k nvme12n17 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.2M 1.1M 0.0k 11.9M 11.0M 0.0k nvme12n18 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.2M 1.3M 0.0k 11.8M 12.6M 0.0k nvme12n19 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 1.2M 1.2M 0.0k 12.2M 11.9M 0.0k nvme12n20 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.2M 1.2M 0.0k 11.9M 12.5M 0.0k nvme4n11 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 1.2M 1.2M 0.0k 12.3M 11.6M 0.0k nvme4n12 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 83.60 1.1M 1.1M 0.0k 11.0M 10.9M 0.0k nvme4n13 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.1M 1.3M 0.0k 11.3M 12.6M 0.0k nvme4n14 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 97.10 1.3M 1.3M 0.0k 12.7M 13.0M 0.0k nvme4n15 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 102.50 1.4M 1.4M 0.0k 13.7M 13.8M 0.0k nvme4n16 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.1M 1.2M 0.0k 11.5M 12.4M 0.0k nvme4n17 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 97.00 1.3M 1.3M 0.0k 12.6M 12.8M 0.0k nvme4n18 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 102.60 1.3M 1.3M 0.0k 13.4M 13.0M 0.0k nvme4n19 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.3M 1.1M 0.0k 12.8M 11.4M 0.0k nvme4n20 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 101.20 1.3M 1.3M 0.0k 12.6M 12.8M 0.0k nvme8n11 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 97.10 1.3M 1.3M 0.0k 12.8M 12.9M 0.0k nvme8n12 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 99.20 1.4M 1.2M 0.0k 14.1M 12.1M 0.0k nvme8n13 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.3M 1.2M 0.0k 12.6M 12.0M 0.0k nvme8n14 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.3M 1.3M 0.0k 13.3M 12.7M 0.0k nvme8n15 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.2M 1.3M 0.0k 11.7M 13.0M 0.0k nvme8n16 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 97.90 1.2M 1.3M 0.0k 11.8M 12.8M 0.0k nvme8n17 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 1.2M 1.2M 0.0k 12.1M 12.0M 0.0k nvme8n18 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 97.40 1.3M 1.3M 0.0k 12.6M 12.8M 0.0k nvme8n19 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 1.2M 1.1M 0.0k 11.9M 11.3M 0.0k nvme8n20 2026-02-18T03:20:43.978 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:44.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:44 trial097 ceph-mon[21799]: pgmap v194: 33 pgs: 33 active+clean; 58 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 71 MiB/s wr, 5.47k op/s 2026-02-18T03:20:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:44 trial119 ceph-mon[24143]: pgmap v194: 33 pgs: 33 active+clean; 58 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 71 MiB/s wr, 5.47k op/s 2026-02-18T03:20:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:44 trial114 ceph-mon[23907]: pgmap v194: 33 pgs: 33 active+clean; 58 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 71 MiB/s wr, 5.47k op/s 2026-02-18T03:20:45.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1302831568' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:45.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1302831568' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:45.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1302831568' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:46.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:46 trial097 ceph-mon[21799]: pgmap v195: 33 pgs: 33 active+clean; 58 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 75 MiB/s wr, 5.80k op/s 2026-02-18T03:20:46.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1211579751' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:46.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/272850205' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:46 trial119 ceph-mon[24143]: pgmap v195: 33 pgs: 33 active+clean; 58 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 75 MiB/s wr, 5.80k op/s 2026-02-18T03:20:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1211579751' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/272850205' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:46 trial114 ceph-mon[23907]: pgmap v195: 33 pgs: 33 active+clean; 58 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 75 MiB/s wr, 5.80k op/s 2026-02-18T03:20:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1211579751' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/272850205' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:48.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:48 trial097 ceph-mon[21799]: pgmap v196: 33 pgs: 33 active+clean; 58 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 79 MiB/s wr, 6.08k op/s 2026-02-18T03:20:48.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3716583043' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:48 trial119 ceph-mon[24143]: pgmap v196: 33 pgs: 33 active+clean; 58 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 79 MiB/s wr, 6.08k op/s 2026-02-18T03:20:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3716583043' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:48 trial114 ceph-mon[23907]: pgmap v196: 33 pgs: 33 active+clean; 58 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s rd, 79 MiB/s wr, 6.08k op/s 2026-02-18T03:20:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3716583043' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:50.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:50 trial097 ceph-mon[21799]: pgmap v197: 33 pgs: 33 active+clean; 58 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 68 MiB/s wr, 5.28k op/s 2026-02-18T03:20:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:50 trial119 ceph-mon[24143]: pgmap v197: 33 pgs: 33 active+clean; 58 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 68 MiB/s wr, 5.28k op/s 2026-02-18T03:20:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:50 trial114 ceph-mon[23907]: pgmap v197: 33 pgs: 33 active+clean; 58 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 68 MiB/s wr, 5.28k op/s 2026-02-18T03:20:52.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:52 trial097 ceph-mon[21799]: pgmap v198: 33 pgs: 33 active+clean; 58 GiB data, 44 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 76 MiB/s wr, 5.96k op/s 2026-02-18T03:20:52.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:52 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3795553487' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:52 trial119 ceph-mon[24143]: pgmap v198: 33 pgs: 33 active+clean; 58 GiB data, 44 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 76 MiB/s wr, 5.96k op/s 2026-02-18T03:20:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:52 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3795553487' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:52 trial114 ceph-mon[23907]: pgmap v198: 33 pgs: 33 active+clean; 58 GiB data, 44 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 76 MiB/s wr, 5.96k op/s 2026-02-18T03:20:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:52 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3795553487' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:53.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:53.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.70 1.2M 1.1M 0.0k 11.6M 10.8M 0.0k nvme12n1 2026-02-18T03:20:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.2M 1.1M 0.0k 12.1M 11.5M 0.0k nvme12n10 2026-02-18T03:20:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.2M 1.2M 0.0k 11.9M 11.7M 0.0k nvme12n2 2026-02-18T03:20:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.1M 1.3M 0.0k 11.4M 13.0M 0.0k nvme12n3 2026-02-18T03:20:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.1M 1.2M 0.0k 11.5M 12.1M 0.0k nvme12n4 2026-02-18T03:20:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 1.3M 1.2M 0.0k 12.5M 11.7M 0.0k nvme12n5 2026-02-18T03:20:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.1M 1.2M 0.0k 11.5M 12.1M 0.0k nvme12n6 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.2M 1.2M 0.0k 11.7M 11.6M 0.0k nvme12n7 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.2M 1.1M 0.0k 11.7M 11.3M 0.0k nvme12n8 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 1.2M 1.2M 0.0k 11.9M 11.9M 0.0k nvme12n9 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.1M 1.1M 0.0k 11.4M 10.7M 0.0k nvme4n1 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.1M 1.1M 0.0k 11.5M 11.0M 0.0k nvme4n10 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.20 1.3M 1.2M 0.0k 12.6M 11.6M 0.0k nvme4n2 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.80 1.2M 1.3M 0.0k 12.3M 12.9M 0.0k nvme4n3 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 1.2M 1.3M 0.0k 11.8M 12.5M 0.0k nvme4n4 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 1.2M 1.2M 0.0k 11.9M 11.6M 0.0k nvme4n5 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.50 988.4k 1.3M 0.0k 9.7M 12.6M 0.0k nvme4n6 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 1.1M 1.1M 0.0k 11.2M 10.7M 0.0k nvme4n7 2026-02-18T03:20:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.1M 1.2M 0.0k 10.6M 11.5M 0.0k nvme4n8 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.1M 1.2M 0.0k 11.0M 11.9M 0.0k nvme4n9 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.1M 1.1M 0.0k 11.2M 11.3M 0.0k nvme8n1 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 1.2M 1.2M 0.0k 11.7M 12.0M 0.0k nvme8n10 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 1.2M 1.2M 0.0k 12.2M 11.8M 0.0k nvme8n2 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.2M 1.2M 0.0k 11.7M 11.6M 0.0k nvme8n3 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 1.3M 1.3M 0.0k 12.7M 12.9M 0.0k nvme8n4 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.3M 1.2M 0.0k 12.8M 12.1M 0.0k nvme8n5 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 1.2M 1.2M 0.0k 12.1M 11.8M 0.0k nvme8n6 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 101.40 1.3M 1.3M 0.0k 13.4M 13.1M 0.0k nvme8n7 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.2M 1.2M 0.0k 12.4M 12.4M 0.0k nvme8n8 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 101.90 1.3M 1.2M 0.0k 13.3M 12.1M 0.0k nvme8n9 2026-02-18T03:20:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:20:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/763976709' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:53.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3825649171' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:53.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/763976709' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:53.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3825649171' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:53.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/763976709' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:53.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3825649171' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:53.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:53.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:20:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.2M 1.1M 0.0k 11.9M 11.4M 0.0k nvme12n11 2026-02-18T03:20:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.2M 1.2M 0.0k 11.7M 11.8M 0.0k nvme12n12 2026-02-18T03:20:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 1.1M 1.2M 0.0k 11.1M 12.2M 0.0k nvme12n13 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.00 1.1M 1.3M 0.0k 10.7M 12.7M 0.0k nvme12n14 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.2M 1.2M 0.0k 11.8M 11.6M 0.0k nvme12n15 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1.1M 1.2M 0.0k 11.3M 12.4M 0.0k nvme12n16 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.1M 1.2M 0.0k 11.2M 12.0M 0.0k nvme12n17 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 1.2M 1.2M 0.0k 12.0M 11.8M 0.0k nvme12n18 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.2M 1.2M 0.0k 11.5M 11.9M 0.0k nvme12n19 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.90 1.3M 1.2M 0.0k 12.9M 11.9M 0.0k nvme12n20 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.70 1.3M 1.2M 0.0k 12.5M 12.1M 0.0k nvme4n11 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 100.00 1.3M 1.2M 0.0k 13.4M 12.3M 0.0k nvme4n12 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 1.1M 1.3M 0.0k 10.8M 12.8M 0.0k nvme4n13 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.1M 1.2M 0.0k 11.4M 12.1M 0.0k nvme4n14 2026-02-18T03:20:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.2M 1.2M 0.0k 12.4M 12.2M 0.0k nvme4n15 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 1.1M 1.2M 0.0k 10.7M 12.4M 0.0k nvme4n16 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 1.2M 1.2M 0.0k 11.5M 11.9M 0.0k nvme4n17 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.00 1.2M 1.2M 0.0k 11.7M 12.2M 0.0k nvme4n18 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.2M 1.2M 0.0k 11.5M 12.1M 0.0k nvme4n19 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 1.1M 1.1M 0.0k 11.3M 10.9M 0.0k nvme4n20 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.60 1.2M 1.2M 0.0k 11.9M 12.4M 0.0k nvme8n11 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.30 1.2M 1.2M 0.0k 12.1M 12.5M 0.0k nvme8n12 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.90 1.2M 1.2M 0.0k 12.2M 11.6M 0.0k nvme8n13 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 1.2M 1.2M 0.0k 12.5M 11.7M 0.0k nvme8n14 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.2M 1.2M 0.0k 11.5M 12.3M 0.0k nvme8n15 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.50 1.2M 1.2M 0.0k 12.1M 12.0M 0.0k nvme8n16 2026-02-18T03:20:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.30 1.3M 1.3M 0.0k 13.3M 12.9M 0.0k nvme8n17 2026-02-18T03:20:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.70 1.3M 1.2M 0.0k 12.7M 12.5M 0.0k nvme8n18 2026-02-18T03:20:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 99.30 1.3M 1.2M 0.0k 13.3M 12.0M 0.0k nvme8n19 2026-02-18T03:20:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.00 1.2M 1.2M 0.0k 12.3M 12.3M 0.0k nvme8n20 2026-02-18T03:20:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:20:54.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:54 trial097 ceph-mon[21799]: pgmap v199: 33 pgs: 33 active+clean; 58 GiB data, 44 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 69 MiB/s wr, 5.42k op/s 2026-02-18T03:20:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:54 trial119 ceph-mon[24143]: pgmap v199: 33 pgs: 33 active+clean; 58 GiB data, 44 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 69 MiB/s wr, 5.42k op/s 2026-02-18T03:20:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:54 trial114 ceph-mon[23907]: pgmap v199: 33 pgs: 33 active+clean; 58 GiB data, 44 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 69 MiB/s wr, 5.42k op/s 2026-02-18T03:20:55.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1581145809' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1581145809' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:55.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1581145809' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:56.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:56 trial097 ceph-mon[21799]: pgmap v200: 33 pgs: 33 active+clean; 58 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 74 MiB/s wr, 5.77k op/s 2026-02-18T03:20:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:56 trial119 ceph-mon[24143]: pgmap v200: 33 pgs: 33 active+clean; 58 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 74 MiB/s wr, 5.77k op/s 2026-02-18T03:20:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:56 trial114 ceph-mon[23907]: pgmap v200: 33 pgs: 33 active+clean; 58 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 74 MiB/s wr, 5.77k op/s 2026-02-18T03:20:58.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:20:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:20:57] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:20:58.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:20:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:20:57] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:20:58.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:20:57 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:20:57] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:20:58.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:58 trial097 ceph-mon[21799]: pgmap v201: 33 pgs: 33 active+clean; 59 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 77 MiB/s wr, 6.11k op/s 2026-02-18T03:20:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:58 trial119 ceph-mon[24143]: pgmap v201: 33 pgs: 33 active+clean; 59 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 77 MiB/s wr, 6.11k op/s 2026-02-18T03:20:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:58 trial114 ceph-mon[23907]: pgmap v201: 33 pgs: 33 active+clean; 59 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 77 MiB/s wr, 6.11k op/s 2026-02-18T03:20:59.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:20:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:20:59] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:20:59.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:20:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:20:59] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:20:59.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:20:59 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:20:59] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:20:59.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:20:59 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3596861309' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:59.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:20:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:20:59] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:20:59.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:20:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:20:59] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:20:59.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:20:59 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:20:59] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:20:59.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:20:59 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3596861309' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:20:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:20:59 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3596861309' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:21:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:21:00] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:21:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:21:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:21:00] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:21:00.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:21:00 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:21:00] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:21:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:00 trial097 ceph-mon[21799]: pgmap v202: 33 pgs: 33 active+clean; 59 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 67 MiB/s wr, 5.30k op/s 2026-02-18T03:21:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:21:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3644638718' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:00 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3632549718' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:21:00.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:21:00.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:21:00.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:21:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:00 trial119 ceph-mon[24143]: pgmap v202: 33 pgs: 33 active+clean; 59 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 67 MiB/s wr, 5.30k op/s 2026-02-18T03:21:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:21:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:00 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3644638718' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:00 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3632549718' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:21:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:21:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:21:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:21:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:00 trial114 ceph-mon[23907]: pgmap v202: 33 pgs: 33 active+clean; 59 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 67 MiB/s wr, 5.30k op/s 2026-02-18T03:21:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:21:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:00 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3644638718' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:00 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3632549718' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:21:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:21:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:21:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:21:02.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:02 trial097 ceph-mon[21799]: pgmap v203: 33 pgs: 33 active+clean; 59 GiB data, 46 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 75 MiB/s wr, 5.95k op/s 2026-02-18T03:21:02.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/787679361' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:02 trial119 ceph-mon[24143]: pgmap v203: 33 pgs: 33 active+clean; 59 GiB data, 46 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 75 MiB/s wr, 5.95k op/s 2026-02-18T03:21:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/787679361' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:02 trial114 ceph-mon[23907]: pgmap v203: 33 pgs: 33 active+clean; 59 GiB data, 46 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 75 MiB/s wr, 5.95k op/s 2026-02-18T03:21:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/787679361' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:03.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:03.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.1M 1.1M 0.0k 11.4M 11.1M 0.0k nvme12n1 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 100.50 1.3M 1.2M 0.0k 12.7M 11.6M 0.0k nvme12n10 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 98.50 1.2M 1.2M 0.0k 11.7M 12.5M 0.0k nvme12n2 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.2M 1.1M 0.0k 11.7M 10.9M 0.0k nvme12n3 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.70 1.2M 1.2M 0.0k 11.7M 11.8M 0.0k nvme12n4 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.20 1.1M 1.1M 0.0k 10.5M 11.3M 0.0k nvme12n5 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 97.80 1.2M 1.2M 0.0k 12.2M 11.8M 0.0k nvme12n6 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 100.60 1.2M 1.3M 0.0k 12.0M 13.3M 0.0k nvme12n7 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 99.40 1.3M 1.2M 0.0k 13.1M 12.2M 0.0k nvme12n8 2026-02-18T03:21:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.1M 1.2M 0.0k 11.2M 12.2M 0.0k nvme12n9 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.2M 1.2M 0.0k 11.8M 12.1M 0.0k nvme4n1 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.70 1.2M 1.1M 0.0k 11.8M 11.4M 0.0k nvme4n10 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.2M 1.1M 0.0k 12.4M 11.4M 0.0k nvme4n2 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 99.60 1.2M 1.2M 0.0k 12.3M 12.4M 0.0k nvme4n3 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.1M 1.2M 0.0k 11.2M 12.5M 0.0k nvme4n4 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.40 1.2M 1.1M 0.0k 12.0M 11.0M 0.0k nvme4n5 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.1M 1.1M 0.0k 11.3M 11.4M 0.0k nvme4n6 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.2M 1.3M 0.0k 11.7M 12.6M 0.0k nvme4n7 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.1M 1.2M 0.0k 11.0M 11.9M 0.0k nvme4n8 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.2M 1.1M 0.0k 12.4M 11.1M 0.0k nvme4n9 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.2M 1.2M 0.0k 11.7M 11.9M 0.0k nvme8n1 2026-02-18T03:21:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.1M 1.1M 0.0k 10.6M 11.5M 0.0k nvme8n10 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 98.20 1.3M 1.2M 0.0k 13.1M 11.7M 0.0k nvme8n2 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 1.2M 1.2M 0.0k 12.3M 11.7M 0.0k nvme8n3 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 98.40 1.3M 1.2M 0.0k 12.9M 11.8M 0.0k nvme8n4 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.30 1002.4k 1.2M 0.0k 9.8M 11.9M 0.0k nvme8n5 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 1.1M 1.2M 0.0k 10.9M 11.6M 0.0k nvme8n6 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.2M 1.2M 0.0k 12.0M 11.7M 0.0k nvme8n7 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.2M 1.2M 0.0k 11.7M 11.7M 0.0k nvme8n8 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 99.90 1.2M 1.2M 0.0k 11.7M 11.8M 0.0k nvme8n9 2026-02-18T03:21:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:03.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:03.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.2M 1.1M 0.0k 11.7M 11.4M 0.0k nvme12n11 2026-02-18T03:21:03.979 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.1M 1.1M 0.0k 10.9M 11.4M 0.0k nvme12n12 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 1.3M 1.2M 0.0k 12.5M 12.0M 0.0k nvme12n13 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 1.2M 1.1M 0.0k 11.9M 10.7M 0.0k nvme12n14 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.1M 1.2M 0.0k 11.3M 11.6M 0.0k nvme12n15 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 1.2M 1.1M 0.0k 11.9M 11.3M 0.0k nvme12n16 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 1.1M 1.2M 0.0k 10.9M 11.8M 0.0k nvme12n17 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 1.1M 1.1M 0.0k 11.0M 10.5M 0.0k nvme12n18 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.3M 1.2M 0.0k 12.6M 11.9M 0.0k nvme12n19 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.20 1.2M 1.2M 0.0k 12.3M 11.8M 0.0k nvme12n20 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.60 1.2M 1.2M 0.0k 12.4M 12.3M 0.0k nvme4n11 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.00 1.2M 1.3M 0.0k 12.2M 12.5M 0.0k nvme4n12 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.2M 1.2M 0.0k 11.5M 11.7M 0.0k nvme4n13 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.1M 1.2M 0.0k 11.0M 12.2M 0.0k nvme4n14 2026-02-18T03:21:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.2M 1.1M 0.0k 12.4M 11.2M 0.0k nvme4n15 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.80 1.3M 1.2M 0.0k 12.9M 12.3M 0.0k nvme4n16 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.1M 1.2M 0.0k 11.3M 11.7M 0.0k nvme4n17 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.0M 1.2M 0.0k 10.2M 11.9M 0.0k nvme4n18 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 1.3M 1.2M 0.0k 12.6M 11.9M 0.0k nvme4n19 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.2M 1.2M 0.0k 12.1M 11.8M 0.0k nvme4n20 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 102.00 1.4M 1.2M 0.0k 13.9M 12.2M 0.0k nvme8n11 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 103.60 1.4M 1.2M 0.0k 13.8M 12.5M 0.0k nvme8n12 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.2M 1.2M 0.0k 12.3M 12.1M 0.0k nvme8n13 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.2M 1.1M 0.0k 11.6M 11.1M 0.0k nvme8n14 2026-02-18T03:21:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 1.2M 1.2M 0.0k 11.5M 12.1M 0.0k nvme8n15 2026-02-18T03:21:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.2M 1.2M 0.0k 11.8M 12.4M 0.0k nvme8n16 2026-02-18T03:21:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.00 1.2M 1.2M 0.0k 12.3M 12.0M 0.0k nvme8n17 2026-02-18T03:21:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.60 1.2M 1.2M 0.0k 12.4M 12.2M 0.0k nvme8n18 2026-02-18T03:21:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.90 1.2M 1.1M 0.0k 12.2M 11.3M 0.0k nvme8n19 2026-02-18T03:21:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.0M 1.1M 0.0k 10.2M 10.7M 0.0k nvme8n20 2026-02-18T03:21:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:04 trial097 ceph-mon[21799]: pgmap v204: 33 pgs: 33 active+clean; 59 GiB data, 46 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 67 MiB/s wr, 5.42k op/s 2026-02-18T03:21:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:04 trial119 ceph-mon[24143]: pgmap v204: 33 pgs: 33 active+clean; 59 GiB data, 46 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 67 MiB/s wr, 5.42k op/s 2026-02-18T03:21:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:04 trial114 ceph-mon[23907]: pgmap v204: 33 pgs: 33 active+clean; 59 GiB data, 46 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 67 MiB/s wr, 5.42k op/s 2026-02-18T03:21:06.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:06 trial097 ceph-mon[21799]: pgmap v205: 33 pgs: 33 active+clean; 59 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 72 MiB/s wr, 5.79k op/s 2026-02-18T03:21:06.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:06 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1925761107' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:06 trial119 ceph-mon[24143]: pgmap v205: 33 pgs: 33 active+clean; 59 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 72 MiB/s wr, 5.79k op/s 2026-02-18T03:21:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:06 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1925761107' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:06 trial114 ceph-mon[23907]: pgmap v205: 33 pgs: 33 active+clean; 59 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 72 MiB/s wr, 5.79k op/s 2026-02-18T03:21:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:06 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1925761107' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:07.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:07 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3009614256' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:07.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:07 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3536980661' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:07.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:07 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3009614256' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:07.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:07 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3536980661' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:07.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:07 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3009614256' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:07.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:07 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3536980661' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:08.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:08 trial097 ceph-mon[21799]: pgmap v206: 33 pgs: 33 active+clean; 59 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 76 MiB/s wr, 6.11k op/s 2026-02-18T03:21:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:08 trial119 ceph-mon[24143]: pgmap v206: 33 pgs: 33 active+clean; 59 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 76 MiB/s wr, 6.11k op/s 2026-02-18T03:21:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:08 trial114 ceph-mon[23907]: pgmap v206: 33 pgs: 33 active+clean; 59 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s rd, 76 MiB/s wr, 6.11k op/s 2026-02-18T03:21:09.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1680187512' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:09.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1680187512' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:09.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1680187512' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:10.864 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:10 trial119 ceph-mon[24143]: pgmap v207: 33 pgs: 33 active+clean; 59 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.28k op/s 2026-02-18T03:21:10.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:10 trial097 ceph-mon[21799]: pgmap v207: 33 pgs: 33 active+clean; 59 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.28k op/s 2026-02-18T03:21:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:10 trial114 ceph-mon[23907]: pgmap v207: 33 pgs: 33 active+clean; 59 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.28k op/s 2026-02-18T03:21:12.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:12 trial097 ceph-mon[21799]: pgmap v208: 33 pgs: 33 active+clean; 59 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.27k op/s 2026-02-18T03:21:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:12 trial119 ceph-mon[24143]: pgmap v208: 33 pgs: 33 active+clean; 59 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.27k op/s 2026-02-18T03:21:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:12 trial114 ceph-mon[23907]: pgmap v208: 33 pgs: 33 active+clean; 59 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.27k op/s 2026-02-18T03:21:13.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:13.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 1.0M 1.1M 0.0k 10.5M 11.4M 0.0k nvme12n1 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.2M 1.2M 0.0k 12.0M 12.0M 0.0k nvme12n10 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.2M 1.1M 0.0k 11.5M 10.7M 0.0k nvme12n2 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.1M 1.1M 0.0k 11.3M 10.8M 0.0k nvme12n3 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.1M 1.1M 0.0k 10.6M 10.8M 0.0k nvme12n4 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.00 1.1M 1.1M 0.0k 10.5M 11.5M 0.0k nvme12n5 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.1M 1.1M 0.0k 11.0M 11.1M 0.0k nvme12n6 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.30 1.3M 1.0M 0.0k 12.7M 10.5M 0.0k nvme12n7 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.90 1.3M 1.1M 0.0k 12.6M 11.2M 0.0k nvme12n8 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 1.2M 1.1M 0.0k 11.9M 11.4M 0.0k nvme12n9 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 1.1M 1.1M 0.0k 11.3M 10.7M 0.0k nvme4n1 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.50 1010.4k 1.2M 0.0k 9.9M 12.3M 0.0k nvme4n10 2026-02-18T03:21:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.1M 1.2M 0.0k 11.0M 11.5M 0.0k nvme4n2 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.1M 1.1M 0.0k 11.3M 11.1M 0.0k nvme4n3 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.1M 1.2M 0.0k 11.4M 11.6M 0.0k nvme4n4 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.2M 1.1M 0.0k 12.3M 11.4M 0.0k nvme4n5 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.2M 1.1M 0.0k 11.8M 11.3M 0.0k nvme4n6 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.30 997.6k 1.2M 0.0k 9.7M 11.5M 0.0k nvme4n7 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.1M 1.2M 0.0k 10.7M 12.2M 0.0k nvme4n8 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.70 1.0M 1.1M 0.0k 10.4M 10.6M 0.0k nvme4n9 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.80 1.2M 1.1M 0.0k 12.4M 11.5M 0.0k nvme8n1 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.2M 1.1M 0.0k 11.7M 11.3M 0.0k nvme8n10 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.1M 1.2M 0.0k 11.4M 12.4M 0.0k nvme8n2 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.2M 1.1M 0.0k 11.9M 11.5M 0.0k nvme8n3 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.90 1.2M 1.2M 0.0k 11.7M 12.1M 0.0k nvme8n4 2026-02-18T03:21:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.2M 1.2M 0.0k 11.9M 12.3M 0.0k nvme8n5 2026-02-18T03:21:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.60 1.2M 1.2M 0.0k 12.0M 11.5M 0.0k nvme8n6 2026-02-18T03:21:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.50 1.3M 1.1M 0.0k 12.8M 11.2M 0.0k nvme8n7 2026-02-18T03:21:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 1.1M 1.1M 0.0k 11.1M 11.4M 0.0k nvme8n8 2026-02-18T03:21:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 101.50 1.2M 1.2M 0.0k 11.9M 12.1M 0.0k nvme8n9 2026-02-18T03:21:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:13.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/846376954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:13.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/846376954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:13.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/846376954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:13.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:13.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:13.979 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.0M 1.1M 0.0k 10.3M 11.4M 0.0k nvme12n11 2026-02-18T03:21:13.979 INFO:tasks.workunit.client.1.trial078.stdout: 97.20 1.2M 1.1M 0.0k 12.2M 11.2M 0.0k nvme12n12 2026-02-18T03:21:13.979 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 1.2M 1.2M 0.0k 12.1M 11.6M 0.0k nvme12n13 2026-02-18T03:21:13.979 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1.1M 1.2M 0.0k 11.4M 11.6M 0.0k nvme12n14 2026-02-18T03:21:13.979 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.1M 1.2M 0.0k 10.6M 11.9M 0.0k nvme12n15 2026-02-18T03:21:13.979 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1.0M 1.1M 0.0k 10.4M 10.8M 0.0k nvme12n16 2026-02-18T03:21:13.979 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 1.2M 1.2M 0.0k 12.0M 11.9M 0.0k nvme12n17 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 1.2M 1.1M 0.0k 11.7M 11.0M 0.0k nvme12n18 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.1M 1.2M 0.0k 11.3M 12.0M 0.0k nvme12n19 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.2M 1.3M 0.0k 12.2M 12.8M 0.0k nvme12n20 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.2M 1.1M 0.0k 11.8M 11.3M 0.0k nvme4n11 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 1.0M 1.1M 0.0k 10.2M 10.6M 0.0k nvme4n12 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1.2M 1.2M 0.0k 11.9M 12.0M 0.0k nvme4n13 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.2M 1.2M 0.0k 11.7M 11.7M 0.0k nvme4n14 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.70 1.3M 1.2M 0.0k 12.6M 11.5M 0.0k nvme4n15 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.2M 1.1M 0.0k 11.9M 11.3M 0.0k nvme4n16 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.0M 1.2M 0.0k 10.3M 12.3M 0.0k nvme4n17 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.60 1.2M 1.3M 0.0k 12.2M 13.0M 0.0k nvme4n18 2026-02-18T03:21:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.1M 1.1M 0.0k 11.3M 10.8M 0.0k nvme4n19 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.1M 1.1M 0.0k 10.8M 10.9M 0.0k nvme4n20 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.0M 1.1M 0.0k 10.5M 11.3M 0.0k nvme8n11 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 100.00 1.2M 1.2M 0.0k 11.7M 12.0M 0.0k nvme8n12 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.1M 1.1M 0.0k 11.2M 11.0M 0.0k nvme8n13 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.2M 1.2M 0.0k 11.7M 11.6M 0.0k nvme8n14 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.0M 1.2M 0.0k 10.4M 11.9M 0.0k nvme8n15 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.00 1.2M 1.2M 0.0k 12.0M 11.6M 0.0k nvme8n16 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.90 1.3M 1.1M 0.0k 13.1M 11.4M 0.0k nvme8n17 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.1M 1.2M 0.0k 11.0M 11.7M 0.0k nvme8n18 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1.1M 1.1M 0.0k 10.8M 10.7M 0.0k nvme8n19 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.2M 1.2M 0.0k 11.7M 11.9M 0.0k nvme8n20 2026-02-18T03:21:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:14.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:14 trial097 ceph-mon[21799]: pgmap v209: 33 pgs: 33 active+clean; 59 GiB data, 49 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 67 MiB/s wr, 5.42k op/s 2026-02-18T03:21:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/529633799' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:14.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:14 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2676691475' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:14 trial119 ceph-mon[24143]: pgmap v209: 33 pgs: 33 active+clean; 59 GiB data, 49 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 67 MiB/s wr, 5.42k op/s 2026-02-18T03:21:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/529633799' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:14 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2676691475' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:14 trial114 ceph-mon[23907]: pgmap v209: 33 pgs: 33 active+clean; 59 GiB data, 49 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 67 MiB/s wr, 5.42k op/s 2026-02-18T03:21:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/529633799' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:14.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:14 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2676691475' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:16.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:16 trial097 ceph-mon[21799]: pgmap v210: 33 pgs: 33 active+clean; 59 GiB data, 49 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 71 MiB/s wr, 5.78k op/s 2026-02-18T03:21:16.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1823774075' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:16 trial119 ceph-mon[24143]: pgmap v210: 33 pgs: 33 active+clean; 59 GiB data, 49 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 71 MiB/s wr, 5.78k op/s 2026-02-18T03:21:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1823774075' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:16 trial114 ceph-mon[23907]: pgmap v210: 33 pgs: 33 active+clean; 59 GiB data, 49 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 71 MiB/s wr, 5.78k op/s 2026-02-18T03:21:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1823774075' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:18.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:18 trial097 ceph-mon[21799]: pgmap v211: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 74 MiB/s wr, 6.08k op/s 2026-02-18T03:21:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:18 trial119 ceph-mon[24143]: pgmap v211: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 74 MiB/s wr, 6.08k op/s 2026-02-18T03:21:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:18 trial114 ceph-mon[23907]: pgmap v211: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 74 MiB/s wr, 6.08k op/s 2026-02-18T03:21:20.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:20 trial097 ceph-mon[21799]: pgmap v212: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 64 MiB/s wr, 5.26k op/s 2026-02-18T03:21:20.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:20 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3730123651' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:20 trial119 ceph-mon[24143]: pgmap v212: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 64 MiB/s wr, 5.26k op/s 2026-02-18T03:21:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:20 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3730123651' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:20 trial114 ceph-mon[23907]: pgmap v212: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 64 MiB/s wr, 5.26k op/s 2026-02-18T03:21:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:20 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3730123651' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:21.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:21 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2841469689' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:21.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:21 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/222438240' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:21.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:21 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2841469689' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:21.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:21 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/222438240' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:21.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:21 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2841469689' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:21.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:21 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/222438240' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:22.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:22 trial097 ceph-mon[21799]: pgmap v213: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 64 MiB/s wr, 5.25k op/s 2026-02-18T03:21:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:22 trial119 ceph-mon[24143]: pgmap v213: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 64 MiB/s wr, 5.25k op/s 2026-02-18T03:21:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:22 trial114 ceph-mon[23907]: pgmap v213: 33 pgs: 33 active+clean; 59 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 64 MiB/s wr, 5.25k op/s 2026-02-18T03:21:23.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:23.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 87.30 1.1M 1.1M 0.0k 11.0M 11.1M 0.0k nvme12n1 2026-02-18T03:21:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1.1M 1.1M 0.0k 11.4M 11.2M 0.0k nvme12n10 2026-02-18T03:21:23.497 INFO:tasks.workunit.client.0.trial031.stdout: 95.90 1.1M 1.2M 0.0k 11.1M 11.9M 0.0k nvme12n2 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.1M 1.2M 0.0k 10.8M 11.5M 0.0k nvme12n3 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.60 1.2M 1.1M 0.0k 11.8M 10.8M 0.0k nvme12n4 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.1M 1.2M 0.0k 11.0M 12.2M 0.0k nvme12n5 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.1M 1.2M 0.0k 11.1M 11.8M 0.0k nvme12n6 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 100.20 1.2M 1.3M 0.0k 11.6M 12.6M 0.0k nvme12n7 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 1.1M 1.1M 0.0k 11.3M 10.9M 0.0k nvme12n8 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.2M 1.0M 0.0k 11.6M 10.2M 0.0k nvme12n9 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.1M 1.1M 0.0k 10.7M 11.2M 0.0k nvme4n1 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 96.90 1.2M 1.1M 0.0k 12.4M 11.4M 0.0k nvme4n10 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 97.20 1.1M 1.2M 0.0k 11.1M 11.8M 0.0k nvme4n2 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 98.70 1.3M 1.1M 0.0k 13.1M 11.5M 0.0k nvme4n3 2026-02-18T03:21:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.1M 1.1M 0.0k 11.2M 11.2M 0.0k nvme4n4 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.1M 1.1M 0.0k 11.0M 11.2M 0.0k nvme4n5 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.2M 1.0M 0.0k 12.4M 10.2M 0.0k nvme4n6 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 1.0M 1.1M 0.0k 10.5M 10.9M 0.0k nvme4n7 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.2M 1.1M 0.0k 11.9M 11.0M 0.0k nvme4n8 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.3M 1.1M 0.0k 12.6M 11.0M 0.0k nvme4n9 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 992.8k 1.0M 0.0k 9.7M 10.3M 0.0k nvme8n1 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.30 1.2M 1.2M 0.0k 11.7M 12.3M 0.0k nvme8n10 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1.2M 1.1M 0.0k 12.0M 10.9M 0.0k nvme8n2 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 1.1M 1.1M 0.0k 11.2M 10.8M 0.0k nvme8n3 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.20 1.2M 1.0M 0.0k 12.5M 10.4M 0.0k nvme8n4 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 1.1M 1.2M 0.0k 10.6M 11.8M 0.0k nvme8n5 2026-02-18T03:21:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.10 1.3M 1.2M 0.0k 12.5M 11.9M 0.0k nvme8n6 2026-02-18T03:21:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 97.90 1.2M 1.2M 0.0k 11.8M 11.9M 0.0k nvme8n7 2026-02-18T03:21:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.00 1.1M 1.0M 0.0k 11.1M 10.5M 0.0k nvme8n8 2026-02-18T03:21:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 1.2M 1.1M 0.0k 12.1M 10.9M 0.0k nvme8n9 2026-02-18T03:21:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:23.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2821634510' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:23.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2821634510' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:23.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2821634510' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:23.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:23.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.2M 1.3M 0.0k 11.9M 12.5M 0.0k nvme12n11 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.1M 1.1M 0.0k 10.6M 11.3M 0.0k nvme12n12 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.1M 1.2M 0.0k 11.3M 11.7M 0.0k nvme12n13 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.2M 1.1M 0.0k 11.8M 11.4M 0.0k nvme12n14 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.1M 1.2M 0.0k 11.0M 12.0M 0.0k nvme12n15 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.80 1.2M 1.2M 0.0k 11.9M 12.5M 0.0k nvme12n16 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 101.40 1.3M 1.1M 0.0k 13.0M 11.2M 0.0k nvme12n17 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.40 1.3M 1.1M 0.0k 12.6M 11.3M 0.0k nvme12n18 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 101.90 1.3M 1.2M 0.0k 13.5M 11.9M 0.0k nvme12n19 2026-02-18T03:21:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 1.1M 1.1M 0.0k 11.3M 11.0M 0.0k nvme12n20 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 1.1M 1.2M 0.0k 11.1M 11.7M 0.0k nvme4n11 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.1M 1.2M 0.0k 11.2M 11.6M 0.0k nvme4n12 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 1.2M 1.1M 0.0k 11.5M 11.3M 0.0k nvme4n13 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.40 1.2M 1.2M 0.0k 11.7M 11.9M 0.0k nvme4n14 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 1.2M 1.2M 0.0k 11.8M 12.0M 0.0k nvme4n15 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.70 1.2M 1.2M 0.0k 12.0M 11.8M 0.0k nvme4n16 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.0M 1.1M 0.0k 10.5M 10.8M 0.0k nvme4n17 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 1.1M 1.1M 0.0k 11.2M 10.8M 0.0k nvme4n18 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.2M 1.1M 0.0k 12.2M 10.9M 0.0k nvme4n19 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 989.2k 1.2M 0.0k 9.7M 12.2M 0.0k nvme4n20 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 104.60 1.3M 1.3M 0.0k 13.0M 12.7M 0.0k nvme8n11 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.80 1.2M 1.2M 0.0k 12.0M 12.2M 0.0k nvme8n12 2026-02-18T03:21:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.2M 1.0M 0.0k 12.1M 10.5M 0.0k nvme8n13 2026-02-18T03:21:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 1.2M 1.2M 0.0k 12.3M 11.7M 0.0k nvme8n14 2026-02-18T03:21:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 1.1M 1.2M 0.0k 10.6M 11.5M 0.0k nvme8n15 2026-02-18T03:21:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 1.2M 1.2M 0.0k 12.3M 11.6M 0.0k nvme8n16 2026-02-18T03:21:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.1M 1.1M 0.0k 11.1M 11.5M 0.0k nvme8n17 2026-02-18T03:21:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.50 1.1M 1.2M 0.0k 11.4M 11.6M 0.0k nvme8n18 2026-02-18T03:21:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.1M 1.1M 0.0k 10.9M 11.4M 0.0k nvme8n19 2026-02-18T03:21:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.1M 1.1M 0.0k 11.2M 11.4M 0.0k nvme8n20 2026-02-18T03:21:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:24.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:24 trial097 ceph-mon[21799]: pgmap v214: 33 pgs: 33 active+clean; 59 GiB data, 51 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 74 MiB/s wr, 6.08k op/s 2026-02-18T03:21:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:24 trial119 ceph-mon[24143]: pgmap v214: 33 pgs: 33 active+clean; 59 GiB data, 51 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 74 MiB/s wr, 6.08k op/s 2026-02-18T03:21:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:24 trial114 ceph-mon[23907]: pgmap v214: 33 pgs: 33 active+clean; 59 GiB data, 51 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 74 MiB/s wr, 6.08k op/s 2026-02-18T03:21:26.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:26 trial097 ceph-mon[21799]: pgmap v215: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 70 MiB/s wr, 5.79k op/s 2026-02-18T03:21:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:26 trial119 ceph-mon[24143]: pgmap v215: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 70 MiB/s wr, 5.79k op/s 2026-02-18T03:21:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:26 trial114 ceph-mon[23907]: pgmap v215: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 64 MiB/s rd, 70 MiB/s wr, 5.79k op/s 2026-02-18T03:21:27.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:27 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3763300358' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:27.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:27 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3763300358' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:27.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:27 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3763300358' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:28.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:28 trial097 ceph-mon[21799]: pgmap v216: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 73 MiB/s wr, 6.09k op/s 2026-02-18T03:21:28.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/437088499' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:28.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:28 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/4237465998' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:28 trial119 ceph-mon[24143]: pgmap v216: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 73 MiB/s wr, 6.09k op/s 2026-02-18T03:21:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/437088499' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:28 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/4237465998' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:28 trial114 ceph-mon[23907]: pgmap v216: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s rd, 73 MiB/s wr, 6.09k op/s 2026-02-18T03:21:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/437088499' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:28 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/4237465998' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:30.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:30 trial097 ceph-mon[21799]: pgmap v217: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 63 MiB/s wr, 5.25k op/s 2026-02-18T03:21:30.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2919356491' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:30 trial119 ceph-mon[24143]: pgmap v217: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 63 MiB/s wr, 5.25k op/s 2026-02-18T03:21:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2919356491' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:30 trial114 ceph-mon[23907]: pgmap v217: 33 pgs: 33 active+clean; 59 GiB data, 52 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 63 MiB/s wr, 5.25k op/s 2026-02-18T03:21:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2919356491' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:32.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:32 trial097 ceph-mon[21799]: pgmap v218: 33 pgs: 33 active+clean; 59 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.22k op/s 2026-02-18T03:21:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:32 trial119 ceph-mon[24143]: pgmap v218: 33 pgs: 33 active+clean; 59 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.22k op/s 2026-02-18T03:21:32.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:32 trial114 ceph-mon[23907]: pgmap v218: 33 pgs: 33 active+clean; 59 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.22k op/s 2026-02-18T03:21:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:33.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.90 1.2M 1.2M 0.0k 11.5M 11.6M 0.0k nvme12n1 2026-02-18T03:21:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.70 1.0M 1.0M 0.0k 10.5M 10.5M 0.0k nvme12n10 2026-02-18T03:21:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.2M 1.1M 0.0k 11.6M 10.8M 0.0k nvme12n2 2026-02-18T03:21:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 100.10 1.2M 1.1M 0.0k 12.4M 11.4M 0.0k nvme12n3 2026-02-18T03:21:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.1M 1.1M 0.0k 10.8M 11.2M 0.0k nvme12n4 2026-02-18T03:21:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 1.2M 1.0M 0.0k 11.6M 10.0M 0.0k nvme12n5 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.1M 1.1M 0.0k 11.0M 11.1M 0.0k nvme12n6 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.1M 1.1M 0.0k 11.4M 10.7M 0.0k nvme12n7 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.1M 1.1M 0.0k 10.6M 11.4M 0.0k nvme12n8 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.1M 1.1M 0.0k 10.7M 10.9M 0.0k nvme12n9 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.1M 1.0M 0.0k 10.6M 10.5M 0.0k nvme4n1 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.1M 1.1M 0.0k 10.8M 11.2M 0.0k nvme4n10 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.1M 1.1M 0.0k 11.1M 10.6M 0.0k nvme4n2 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.90 1.2M 1.1M 0.0k 12.1M 11.2M 0.0k nvme4n3 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 1.0M 1.1M 0.0k 10.3M 11.0M 0.0k nvme4n4 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 1.1M 1.2M 0.0k 11.4M 11.8M 0.0k nvme4n5 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 1.1M 1.1M 0.0k 11.0M 11.4M 0.0k nvme4n6 2026-02-18T03:21:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 1.1M 1.2M 0.0k 11.4M 12.0M 0.0k nvme4n7 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.0M 1.1M 0.0k 10.1M 10.9M 0.0k nvme4n8 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 1.1M 1.2M 0.0k 11.0M 12.0M 0.0k nvme4n9 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 1.2M 1.2M 0.0k 11.7M 11.7M 0.0k nvme8n1 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 99.00 1.3M 1.2M 0.0k 13.0M 11.9M 0.0k nvme8n10 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.1M 1.2M 0.0k 10.7M 11.5M 0.0k nvme8n2 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.1M 1.0M 0.0k 10.6M 10.1M 0.0k nvme8n3 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.1M 1.1M 0.0k 10.8M 11.2M 0.0k nvme8n4 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.1M 1.1M 0.0k 10.9M 11.2M 0.0k nvme8n5 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.2M 1.1M 0.0k 11.5M 11.3M 0.0k nvme8n6 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 1.0M 1.1M 0.0k 10.3M 11.0M 0.0k nvme8n7 2026-02-18T03:21:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.2M 1.1M 0.0k 11.8M 11.2M 0.0k nvme8n8 2026-02-18T03:21:33.503 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 1.2M 1.2M 0.0k 11.8M 11.6M 0.0k nvme8n9 2026-02-18T03:21:33.503 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:33.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:33.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.2M 1.1M 0.0k 11.8M 11.1M 0.0k nvme12n11 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.10 1018.4k 1.0M 0.0k 9.9M 10.4M 0.0k nvme12n12 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 1.2M 1.1M 0.0k 11.7M 10.7M 0.0k nvme12n13 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.1M 1.1M 0.0k 11.1M 10.7M 0.0k nvme12n14 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.1M 1.1M 0.0k 11.4M 10.6M 0.0k nvme12n15 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.40 1.2M 1.1M 0.0k 11.6M 11.5M 0.0k nvme12n16 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 1.1M 1.2M 0.0k 10.9M 11.8M 0.0k nvme12n17 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.1M 1.1M 0.0k 11.2M 10.7M 0.0k nvme12n18 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.20 1.1M 1.0M 0.0k 10.7M 10.5M 0.0k nvme12n19 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 1008.8k 1.1M 0.0k 9.9M 10.6M 0.0k nvme12n20 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.90 1.1M 1.1M 0.0k 11.2M 10.6M 0.0k nvme4n11 2026-02-18T03:21:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.60 1.1M 1.1M 0.0k 11.0M 11.5M 0.0k nvme4n12 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 1.2M 1.1M 0.0k 12.4M 11.2M 0.0k nvme4n13 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.1M 1.1M 0.0k 10.6M 11.4M 0.0k nvme4n14 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.00 1.1M 1.2M 0.0k 11.3M 11.5M 0.0k nvme4n15 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.2M 1.2M 0.0k 12.4M 11.9M 0.0k nvme4n16 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.0M 1.1M 0.0k 10.3M 10.7M 0.0k nvme4n17 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.60 1.2M 1.2M 0.0k 11.6M 11.5M 0.0k nvme4n18 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.1M 1.2M 0.0k 10.8M 12.2M 0.0k nvme4n19 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.30 1.2M 1012.4k 0.0k 11.5M 9.9M 0.0k nvme4n20 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 1.1M 1.2M 0.0k 11.4M 11.8M 0.0k nvme8n11 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 99.70 1.2M 1.3M 0.0k 12.3M 12.8M 0.0k nvme8n12 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1.1M 1.1M 0.0k 10.7M 11.5M 0.0k nvme8n13 2026-02-18T03:21:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.1M 1.1M 0.0k 11.5M 11.0M 0.0k nvme8n14 2026-02-18T03:21:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.2M 1.1M 0.0k 12.2M 11.2M 0.0k nvme8n15 2026-02-18T03:21:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 1.1M 1.1M 0.0k 11.1M 10.8M 0.0k nvme8n16 2026-02-18T03:21:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 93.80 1.1M 1.1M 0.0k 11.1M 11.4M 0.0k nvme8n17 2026-02-18T03:21:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 100.30 1.2M 1.2M 0.0k 12.3M 11.6M 0.0k nvme8n18 2026-02-18T03:21:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.1M 1.1M 0.0k 11.4M 10.8M 0.0k nvme8n19 2026-02-18T03:21:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.2M 1.2M 0.0k 11.7M 12.0M 0.0k nvme8n20 2026-02-18T03:21:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:34.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:34 trial097 ceph-mon[21799]: pgmap v219: 33 pgs: 33 active+clean; 59 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 72 MiB/s wr, 6.05k op/s 2026-02-18T03:21:34.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:34 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/797410228' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:34 trial119 ceph-mon[24143]: pgmap v219: 33 pgs: 33 active+clean; 59 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 72 MiB/s wr, 6.05k op/s 2026-02-18T03:21:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:34 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/797410228' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:34 trial114 ceph-mon[23907]: pgmap v219: 33 pgs: 33 active+clean; 59 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 67 MiB/s rd, 72 MiB/s wr, 6.05k op/s 2026-02-18T03:21:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:34 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/797410228' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:35.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:35 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/22013991' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:35.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:35 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2916608707' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:35.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:35 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/22013991' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:35.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:35 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2916608707' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:35.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:35 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/22013991' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:35.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:35 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2916608707' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:36.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:36 trial097 ceph-mon[21799]: pgmap v220: 33 pgs: 33 active+clean; 59 GiB data, 54 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.75k op/s 2026-02-18T03:21:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:36 trial119 ceph-mon[24143]: pgmap v220: 33 pgs: 33 active+clean; 59 GiB data, 54 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.75k op/s 2026-02-18T03:21:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:36 trial114 ceph-mon[23907]: pgmap v220: 33 pgs: 33 active+clean; 59 GiB data, 54 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.75k op/s 2026-02-18T03:21:37.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3573004709' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:37.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3573004709' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:37.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3573004709' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:38.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:38 trial097 ceph-mon[21799]: pgmap v221: 33 pgs: 33 active+clean; 59 GiB data, 54 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 72 MiB/s wr, 6.04k op/s 2026-02-18T03:21:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:38 trial119 ceph-mon[24143]: pgmap v221: 33 pgs: 33 active+clean; 59 GiB data, 54 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 72 MiB/s wr, 6.04k op/s 2026-02-18T03:21:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:38 trial114 ceph-mon[23907]: pgmap v221: 33 pgs: 33 active+clean; 59 GiB data, 54 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 72 MiB/s wr, 6.04k op/s 2026-02-18T03:21:40.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:40 trial097 ceph-mon[21799]: pgmap v222: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.24k op/s 2026-02-18T03:21:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:40 trial119 ceph-mon[24143]: pgmap v222: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.24k op/s 2026-02-18T03:21:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:40 trial114 ceph-mon[23907]: pgmap v222: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.24k op/s 2026-02-18T03:21:41.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3185742093' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:41.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3185742093' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:41.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3185742093' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:42.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:42 trial097 ceph-mon[21799]: pgmap v223: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 62 MiB/s wr, 5.23k op/s 2026-02-18T03:21:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:42 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1259630645' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:42.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:42 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3871219416' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:42 trial119 ceph-mon[24143]: pgmap v223: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 62 MiB/s wr, 5.23k op/s 2026-02-18T03:21:42.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:42 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1259630645' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:42.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:42 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3871219416' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:42 trial114 ceph-mon[23907]: pgmap v223: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 62 MiB/s wr, 5.23k op/s 2026-02-18T03:21:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:42 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1259630645' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:42.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:42 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3871219416' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:43.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:43.496 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.1M 1.0M 0.0k 10.6M 10.5M 0.0k nvme12n1 2026-02-18T03:21:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 994.0k 1.1M 0.0k 9.7M 10.8M 0.0k nvme12n10 2026-02-18T03:21:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 1.2M 1.2M 0.0k 11.5M 11.6M 0.0k nvme12n2 2026-02-18T03:21:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.1M 1.1M 0.0k 10.7M 11.4M 0.0k nvme12n3 2026-02-18T03:21:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.1M 973.6k 0.0k 11.3M 9.5M 0.0k nvme12n4 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 85.70 1002.4k 1.1M 0.0k 9.8M 11.0M 0.0k nvme12n5 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 1.1M 1.2M 0.0k 11.4M 11.9M 0.0k nvme12n6 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 101.70 1.2M 1.1M 0.0k 12.2M 11.4M 0.0k nvme12n7 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.1M 1.1M 0.0k 11.2M 10.9M 0.0k nvme12n8 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.0M 1006.4k 0.0k 10.3M 9.8M 0.0k nvme12n9 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 95.80 1.1M 1.1M 0.0k 10.7M 10.9M 0.0k nvme4n1 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.0M 1.1M 0.0k 10.4M 10.8M 0.0k nvme4n10 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1022.8k 1.1M 0.0k 10.0M 11.3M 0.0k nvme4n2 2026-02-18T03:21:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 1.1M 1.1M 0.0k 11.5M 11.4M 0.0k nvme4n3 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.1M 1.1M 0.0k 10.9M 11.4M 0.0k nvme4n4 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.1M 1.1M 0.0k 10.8M 10.5M 0.0k nvme4n5 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 1.3M 1.2M 0.0k 12.7M 11.6M 0.0k nvme4n6 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.1M 1.0M 0.0k 10.7M 10.3M 0.0k nvme4n7 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.1M 1.1M 0.0k 11.1M 10.9M 0.0k nvme4n8 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 82.30 997.6k 1.0M 0.0k 9.7M 10.3M 0.0k nvme4n9 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 97.90 1.2M 1.1M 0.0k 11.7M 11.4M 0.0k nvme8n1 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.1M 1.1M 0.0k 10.7M 11.1M 0.0k nvme8n10 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 99.00 1.3M 1.2M 0.0k 13.0M 12.1M 0.0k nvme8n2 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 98.30 1.1M 1.2M 0.0k 10.6M 11.8M 0.0k nvme8n3 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 1.1M 1.1M 0.0k 11.3M 10.7M 0.0k nvme8n4 2026-02-18T03:21:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.2M 1.1M 0.0k 12.0M 11.1M 0.0k nvme8n5 2026-02-18T03:21:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.0M 1.0M 0.0k 10.2M 10.5M 0.0k nvme8n6 2026-02-18T03:21:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1.0M 1.1M 0.0k 10.0M 11.2M 0.0k nvme8n7 2026-02-18T03:21:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 84.30 1.0M 1.0M 0.0k 10.0M 10.3M 0.0k nvme8n8 2026-02-18T03:21:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.2M 1.2M 0.0k 11.7M 11.7M 0.0k nvme8n9 2026-02-18T03:21:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:43.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:43.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1023.6k 1.0M 0.0k 10.0M 10.3M 0.0k nvme12n11 2026-02-18T03:21:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1.1M 1.1M 0.0k 11.4M 10.8M 0.0k nvme12n12 2026-02-18T03:21:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.10 1.0M 1.1M 0.0k 10.1M 10.9M 0.0k nvme12n13 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.30 1.2M 1.1M 0.0k 12.4M 11.3M 0.0k nvme12n14 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1020.4k 1.1M 0.0k 10.0M 10.5M 0.0k nvme12n15 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.0M 1.1M 0.0k 10.4M 11.3M 0.0k nvme12n16 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.2M 1.1M 0.0k 11.7M 11.0M 0.0k nvme12n17 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.50 1.0M 1.1M 0.0k 10.2M 11.0M 0.0k nvme12n18 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.1M 1.1M 0.0k 11.4M 10.6M 0.0k nvme12n19 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.1M 1.0M 0.0k 10.7M 10.4M 0.0k nvme12n20 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 973.2k 1.1M 0.0k 9.5M 10.9M 0.0k nvme4n11 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1.2M 1.2M 0.0k 11.8M 11.5M 0.0k nvme4n12 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.2M 1.1M 0.0k 11.5M 11.2M 0.0k nvme4n13 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 1.2M 1.1M 0.0k 11.5M 11.3M 0.0k nvme4n14 2026-02-18T03:21:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 1.1M 1.1M 0.0k 10.9M 11.0M 0.0k nvme4n15 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.1M 1.1M 0.0k 11.2M 11.2M 0.0k nvme4n16 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1.1M 1.1M 0.0k 10.8M 10.7M 0.0k nvme4n17 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 101.90 1.2M 1.2M 0.0k 12.4M 12.0M 0.0k nvme4n18 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.1M 1.1M 0.0k 10.8M 11.0M 0.0k nvme4n19 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.00 1.0M 1.0M 0.0k 10.2M 10.4M 0.0k nvme4n20 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 1.1M 1.1M 0.0k 11.0M 10.8M 0.0k nvme8n11 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 98.50 1.3M 1.2M 0.0k 12.7M 11.8M 0.0k nvme8n12 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.90 1.1M 1.1M 0.0k 11.2M 10.7M 0.0k nvme8n13 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.1M 1.0M 0.0k 11.4M 10.4M 0.0k nvme8n14 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 98.90 1.2M 1.2M 0.0k 11.5M 12.4M 0.0k nvme8n15 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.0M 1.1M 0.0k 10.3M 10.5M 0.0k nvme8n16 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1013.6k 1.1M 0.0k 9.9M 11.2M 0.0k nvme8n17 2026-02-18T03:21:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 98.70 1.1M 1.2M 0.0k 11.4M 11.5M 0.0k nvme8n18 2026-02-18T03:21:43.984 INFO:tasks.workunit.client.1.trial078.stdout: 83.70 1.1M 919.6k 0.0k 10.5M 9.0M 0.0k nvme8n19 2026-02-18T03:21:43.984 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.2M 1.1M 0.0k 11.5M 10.8M 0.0k nvme8n20 2026-02-18T03:21:43.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:44.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:44 trial097 ceph-mon[21799]: pgmap v224: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 72 MiB/s wr, 6.04k op/s 2026-02-18T03:21:44.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2517275353' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:44 trial119 ceph-mon[24143]: pgmap v224: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 72 MiB/s wr, 6.04k op/s 2026-02-18T03:21:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2517275353' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:44.977 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:44 trial114 ceph-mon[23907]: pgmap v224: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 66 MiB/s rd, 72 MiB/s wr, 6.04k op/s 2026-02-18T03:21:44.978 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2517275353' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:46.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:46 trial097 ceph-mon[21799]: pgmap v225: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 67 MiB/s wr, 5.72k op/s 2026-02-18T03:21:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:46 trial119 ceph-mon[24143]: pgmap v225: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 67 MiB/s wr, 5.72k op/s 2026-02-18T03:21:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:46 trial114 ceph-mon[23907]: pgmap v225: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 67 MiB/s wr, 5.72k op/s 2026-02-18T03:21:48.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:48 trial097 ceph-mon[21799]: pgmap v226: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 63 MiB/s wr, 5.36k op/s 2026-02-18T03:21:48.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2558262168' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:48 trial119 ceph-mon[24143]: pgmap v226: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 63 MiB/s wr, 5.36k op/s 2026-02-18T03:21:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2558262168' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:48 trial114 ceph-mon[23907]: pgmap v226: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 63 MiB/s wr, 5.36k op/s 2026-02-18T03:21:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2558262168' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:49.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:49 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1428526009' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:49.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:49 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2635142463' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:49.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:49 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1428526009' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:49.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:49 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2635142463' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:49.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:49 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1428526009' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:49.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:49 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2635142463' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:50.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:50 trial097 ceph-mon[21799]: pgmap v227: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 61 MiB/s wr, 5.19k op/s 2026-02-18T03:21:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:50 trial119 ceph-mon[24143]: pgmap v227: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 61 MiB/s wr, 5.19k op/s 2026-02-18T03:21:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:50 trial114 ceph-mon[23907]: pgmap v227: 33 pgs: 33 active+clean; 59 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 61 MiB/s wr, 5.19k op/s 2026-02-18T03:21:51.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:51 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1658391273' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:51.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:51 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1658391273' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:51.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:51 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1658391273' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:52.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:52 trial097 ceph-mon[21799]: pgmap v228: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.18k op/s 2026-02-18T03:21:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:52 trial119 ceph-mon[24143]: pgmap v228: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.18k op/s 2026-02-18T03:21:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:52 trial114 ceph-mon[23907]: pgmap v228: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.18k op/s 2026-02-18T03:21:53.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:53.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1.1M 1.1M 0.0k 11.0M 10.9M 0.0k nvme12n1 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1.1M 1.1M 0.0k 10.7M 10.5M 0.0k nvme12n10 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 1.1M 1.1M 0.0k 10.6M 11.1M 0.0k nvme12n2 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.1M 1.1M 0.0k 10.6M 10.5M 0.0k nvme12n3 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.80 1.0M 1.0M 0.0k 10.4M 10.3M 0.0k nvme12n4 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.0M 1.1M 0.0k 10.3M 10.8M 0.0k nvme12n5 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.90 1.1M 1.1M 0.0k 11.0M 10.9M 0.0k nvme12n6 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.0M 1.2M 0.0k 10.5M 11.5M 0.0k nvme12n7 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.2M 1.0M 0.0k 11.9M 10.4M 0.0k nvme12n8 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.0M 1.0M 0.0k 10.5M 10.0M 0.0k nvme12n9 2026-02-18T03:21:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 934.0k 1.1M 0.0k 9.1M 10.9M 0.0k nvme4n1 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.0M 1.1M 0.0k 10.3M 10.9M 0.0k nvme4n10 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.60 1.2M 1.1M 0.0k 12.5M 11.4M 0.0k nvme4n2 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.10 1013.2k 1.1M 0.0k 9.9M 11.1M 0.0k nvme4n3 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.1M 1.1M 0.0k 11.2M 10.9M 0.0k nvme4n4 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.0M 1.1M 0.0k 10.5M 10.6M 0.0k nvme4n5 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 83.40 1014.4k 1.0M 0.0k 9.9M 10.2M 0.0k nvme4n6 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.20 1.1M 1.1M 0.0k 10.6M 10.6M 0.0k nvme4n7 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.1M 1.0M 0.0k 11.4M 10.2M 0.0k nvme4n8 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 1011.6k 1021.2k 0.0k 9.9M 10.0M 0.0k nvme4n9 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.1M 1.1M 0.0k 10.8M 10.9M 0.0k nvme8n1 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.70 1.0M 1.1M 0.0k 10.1M 11.5M 0.0k nvme8n10 2026-02-18T03:21:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.1M 1.2M 0.0k 10.9M 11.7M 0.0k nvme8n2 2026-02-18T03:21:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 1.1M 1.2M 0.0k 11.3M 11.9M 0.0k nvme8n3 2026-02-18T03:21:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.2M 1.1M 0.0k 11.8M 10.5M 0.0k nvme8n4 2026-02-18T03:21:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 1.1M 1.1M 0.0k 10.7M 10.6M 0.0k nvme8n5 2026-02-18T03:21:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.1M 1.1M 0.0k 11.1M 11.4M 0.0k nvme8n6 2026-02-18T03:21:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.90 1.1M 1.1M 0.0k 11.0M 10.9M 0.0k nvme8n7 2026-02-18T03:21:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 1.1M 1.1M 0.0k 11.0M 11.0M 0.0k nvme8n8 2026-02-18T03:21:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.1M 1.1M 0.0k 10.5M 11.2M 0.0k nvme8n9 2026-02-18T03:21:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:21:53.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 1.1M 1.1M 0.0k 11.2M 10.7M 0.0k nvme12n11 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.1M 1.1M 0.0k 11.2M 11.0M 0.0k nvme12n12 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 1.0M 1.0M 0.0k 10.4M 10.5M 0.0k nvme12n13 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 95.00 1.1M 1.1M 0.0k 11.2M 11.1M 0.0k nvme12n14 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.0M 1.1M 0.0k 10.4M 11.1M 0.0k nvme12n15 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.1M 1.0M 0.0k 11.1M 10.3M 0.0k nvme12n16 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 1.1M 1.1M 0.0k 11.2M 10.8M 0.0k nvme12n17 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.2M 1.1M 0.0k 11.5M 11.4M 0.0k nvme12n18 2026-02-18T03:21:53.979 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 988.4k 1008.0k 0.0k 9.7M 9.8M 0.0k nvme12n19 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.1M 1.0M 0.0k 10.6M 10.1M 0.0k nvme12n20 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1007.2k 1.1M 0.0k 9.8M 11.0M 0.0k nvme4n11 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.2M 1.1M 0.0k 11.7M 10.8M 0.0k nvme4n12 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.2M 1.1M 0.0k 11.7M 10.8M 0.0k nvme4n13 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 1.1M 1.2M 0.0k 11.0M 11.5M 0.0k nvme4n14 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.0M 1.1M 0.0k 10.1M 10.9M 0.0k nvme4n15 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.1M 1.1M 0.0k 11.4M 11.0M 0.0k nvme4n16 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 1.0M 1000.0k 0.0k 10.0M 9.8M 0.0k nvme4n17 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.1M 1.0M 0.0k 10.7M 10.5M 0.0k nvme4n18 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.0M 1.1M 0.0k 10.4M 11.2M 0.0k nvme4n19 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 1010.4k 1.0M 0.0k 9.9M 10.5M 0.0k nvme4n20 2026-02-18T03:21:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 1.2M 1.1M 0.0k 11.6M 11.2M 0.0k nvme8n11 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 1.1M 1.2M 0.0k 10.7M 12.0M 0.0k nvme8n12 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.1M 1.1M 0.0k 10.8M 10.9M 0.0k nvme8n13 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.30 1.0M 1011.6k 0.0k 10.0M 9.9M 0.0k nvme8n14 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 1.1M 1.0M 0.0k 11.3M 10.4M 0.0k nvme8n15 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.0M 1.1M 0.0k 10.2M 10.7M 0.0k nvme8n16 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.1M 1.1M 0.0k 10.8M 10.6M 0.0k nvme8n17 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.10 1.1M 1.1M 0.0k 11.3M 10.7M 0.0k nvme8n18 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.1M 1.1M 0.0k 11.1M 11.5M 0.0k nvme8n19 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.1M 1.1M 0.0k 10.9M 11.1M 0.0k nvme8n20 2026-02-18T03:21:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:21:54.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:54 trial097 ceph-mon[21799]: pgmap v229: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 70 MiB/s wr, 5.99k op/s 2026-02-18T03:21:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:54 trial119 ceph-mon[24143]: pgmap v229: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 70 MiB/s wr, 5.99k op/s 2026-02-18T03:21:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:54 trial114 ceph-mon[23907]: pgmap v229: 33 pgs: 33 active+clean; 59 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s rd, 70 MiB/s wr, 5.99k op/s 2026-02-18T03:21:55.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2751062943' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2751062943' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:55.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2751062943' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:56.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:56 trial097 ceph-mon[21799]: pgmap v230: 33 pgs: 33 active+clean; 59 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 66 MiB/s wr, 5.71k op/s 2026-02-18T03:21:56.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:56 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3894619073' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:56.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:56 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1729597153' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:56 trial119 ceph-mon[24143]: pgmap v230: 33 pgs: 33 active+clean; 59 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 66 MiB/s wr, 5.71k op/s 2026-02-18T03:21:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:56 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3894619073' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:56 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1729597153' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:56 trial114 ceph-mon[23907]: pgmap v230: 33 pgs: 33 active+clean; 59 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 66 MiB/s wr, 5.71k op/s 2026-02-18T03:21:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:56 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3894619073' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:56.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:56 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1729597153' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:58.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:58 trial097 ceph-mon[21799]: pgmap v231: 33 pgs: 33 active+clean; 59 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 62 MiB/s wr, 5.36k op/s 2026-02-18T03:21:58.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:21:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3350276548' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:58 trial119 ceph-mon[24143]: pgmap v231: 33 pgs: 33 active+clean; 59 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 62 MiB/s wr, 5.36k op/s 2026-02-18T03:21:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:21:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3350276548' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:21:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:58 trial114 ceph-mon[23907]: pgmap v231: 33 pgs: 33 active+clean; 59 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 62 MiB/s wr, 5.36k op/s 2026-02-18T03:21:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:21:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3350276548' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:00.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:00 trial097 ceph-mon[21799]: pgmap v232: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 67 MiB/s wr, 5.84k op/s 2026-02-18T03:22:00.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:22:00.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:22:00.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:22:00.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:22:00.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:00 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:22:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:00 trial119 ceph-mon[24143]: pgmap v232: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 67 MiB/s wr, 5.84k op/s 2026-02-18T03:22:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:22:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:22:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:22:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:22:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:00 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:22:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:00 trial114 ceph-mon[23907]: pgmap v232: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 67 MiB/s wr, 5.84k op/s 2026-02-18T03:22:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:22:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:22:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:22:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:22:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:00 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:22:02.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:02 trial097 ceph-mon[21799]: pgmap v233: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 60 MiB/s wr, 5.18k op/s 2026-02-18T03:22:02.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3221243994' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:02 trial119 ceph-mon[24143]: pgmap v233: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 60 MiB/s wr, 5.18k op/s 2026-02-18T03:22:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3221243994' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:02 trial114 ceph-mon[23907]: pgmap v233: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 60 MiB/s wr, 5.18k op/s 2026-02-18T03:22:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3221243994' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:03.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:03.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.0M 1.1M 0.0k 10.1M 10.9M 0.0k nvme12n1 2026-02-18T03:22:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.1M 1.0M 0.0k 10.9M 10.1M 0.0k nvme12n10 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 1.1M 1.1M 0.0k 10.6M 11.2M 0.0k nvme12n2 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.1M 1.1M 0.0k 11.1M 10.6M 0.0k nvme12n3 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1.1M 1.0M 0.0k 10.8M 10.4M 0.0k nvme12n4 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.00 996.0k 1.0M 0.0k 9.7M 10.0M 0.0k nvme12n5 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.1M 1.1M 0.0k 11.3M 10.5M 0.0k nvme12n6 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 98.60 1.1M 1.2M 0.0k 10.9M 11.6M 0.0k nvme12n7 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.1M 1.1M 0.0k 11.2M 10.7M 0.0k nvme12n8 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 989.6k 1.1M 0.0k 9.7M 10.8M 0.0k nvme12n9 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.0M 1.1M 0.0k 10.2M 10.5M 0.0k nvme4n1 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.70 1010.0k 1.0M 0.0k 9.9M 10.3M 0.0k nvme4n10 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 1.2M 1.0M 0.0k 11.6M 10.1M 0.0k nvme4n2 2026-02-18T03:22:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1020.0k 1.1M 0.0k 10.0M 10.9M 0.0k nvme4n3 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.0M 1021.6k 0.0k 10.4M 10.0M 0.0k nvme4n4 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.0M 1.1M 0.0k 10.2M 11.5M 0.0k nvme4n5 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.0M 1.0M 0.0k 10.4M 10.3M 0.0k nvme4n6 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.1M 1.0M 0.0k 10.9M 10.2M 0.0k nvme4n7 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.1M 1010.0k 0.0k 10.6M 9.9M 0.0k nvme4n8 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 83.10 949.6k 981.6k 0.0k 9.3M 9.6M 0.0k nvme4n9 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 98.40 1.2M 1.1M 0.0k 11.6M 11.1M 0.0k nvme8n1 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.0M 1011.2k 0.0k 10.3M 9.9M 0.0k nvme8n10 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 973.2k 1.1M 0.0k 9.5M 10.8M 0.0k nvme8n2 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.0M 1.1M 0.0k 10.3M 10.7M 0.0k nvme8n3 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.80 1.0M 1003.6k 0.0k 10.4M 9.8M 0.0k nvme8n4 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.1M 1.1M 0.0k 10.7M 10.9M 0.0k nvme8n5 2026-02-18T03:22:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.0M 1017.2k 0.0k 10.0M 9.9M 0.0k nvme8n6 2026-02-18T03:22:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 954.0k 1.1M 0.0k 9.3M 10.8M 0.0k nvme8n7 2026-02-18T03:22:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 1.1M 1.0M 0.0k 10.5M 10.4M 0.0k nvme8n8 2026-02-18T03:22:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 103.30 1.1M 1.2M 0.0k 11.3M 11.6M 0.0k nvme8n9 2026-02-18T03:22:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:03.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:03 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1342314607' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:03.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:03 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3990761686' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:03 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1342314607' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:03 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3990761686' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:03 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1342314607' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:03 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3990761686' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:03.973 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:03.976 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.0M 1.1M 0.0k 10.3M 11.1M 0.0k nvme12n11 2026-02-18T03:22:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1010.8k 1020.8k 0.0k 9.9M 10.0M 0.0k nvme12n12 2026-02-18T03:22:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 88.40 1.1M 1.0M 0.0k 10.7M 10.2M 0.0k nvme12n13 2026-02-18T03:22:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.0M 1016.8k 0.0k 10.5M 9.9M 0.0k nvme12n14 2026-02-18T03:22:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 85.40 1008.8k 1.0M 0.0k 9.9M 10.0M 0.0k nvme12n15 2026-02-18T03:22:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 1.0M 1.1M 0.0k 10.3M 11.0M 0.0k nvme12n16 2026-02-18T03:22:03.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.0M 1.1M 0.0k 10.1M 11.0M 0.0k nvme12n17 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1.2M 1.0M 0.0k 11.7M 10.4M 0.0k nvme12n18 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 1.0M 1.1M 0.0k 10.5M 11.0M 0.0k nvme12n19 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1.0M 1.0M 0.0k 10.1M 10.5M 0.0k nvme12n20 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.0M 1.0M 0.0k 10.3M 10.0M 0.0k nvme4n11 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.1M 1.1M 0.0k 11.1M 10.5M 0.0k nvme4n12 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 86.00 989.2k 1.1M 0.0k 9.7M 10.7M 0.0k nvme4n13 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.10 1.2M 1.1M 0.0k 11.8M 10.8M 0.0k nvme4n14 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.1M 1.2M 0.0k 11.2M 11.7M 0.0k nvme4n15 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.0M 994.0k 0.0k 10.4M 9.7M 0.0k nvme4n16 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.0M 1022.0k 0.0k 10.0M 10.0M 0.0k nvme4n17 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.90 1.1M 1.0M 0.0k 11.2M 10.3M 0.0k nvme4n18 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 1.1M 1.1M 0.0k 10.7M 11.1M 0.0k nvme4n19 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.0M 1.1M 0.0k 10.3M 10.8M 0.0k nvme4n20 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.1M 1.1M 0.0k 10.8M 11.0M 0.0k nvme8n11 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 103.50 1.1M 1.2M 0.0k 11.5M 11.9M 0.0k nvme8n12 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 1.0M 1.1M 0.0k 10.2M 11.1M 0.0k nvme8n13 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 1.2M 1.0M 0.0k 11.5M 10.1M 0.0k nvme8n14 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1.1M 1.0M 0.0k 11.4M 10.4M 0.0k nvme8n15 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 1.0M 1020.0k 0.0k 10.2M 10.0M 0.0k nvme8n16 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 1.0M 1.2M 0.0k 10.0M 11.5M 0.0k nvme8n17 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 1.2M 1.1M 0.0k 11.8M 10.9M 0.0k nvme8n18 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.1M 1.0M 0.0k 10.8M 10.5M 0.0k nvme8n19 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.0M 1.1M 0.0k 10.0M 10.8M 0.0k nvme8n20 2026-02-18T03:22:03.977 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:04.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:04 trial097 ceph-mon[21799]: pgmap v234: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.97k op/s 2026-02-18T03:22:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:04 trial119 ceph-mon[24143]: pgmap v234: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.97k op/s 2026-02-18T03:22:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:04 trial114 ceph-mon[23907]: pgmap v234: 33 pgs: 33 active+clean; 59 GiB data, 58 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.97k op/s 2026-02-18T03:22:05.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:05 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/637057666' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:05.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:05 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/637057666' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:06.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:05 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/637057666' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:06 trial119 ceph-mon[24143]: pgmap v235: 33 pgs: 33 active+clean; 59 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.68k op/s 2026-02-18T03:22:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:06 trial114 ceph-mon[23907]: pgmap v235: 33 pgs: 33 active+clean; 59 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.68k op/s 2026-02-18T03:22:07.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:06 trial097 ceph-mon[21799]: pgmap v235: 33 pgs: 33 active+clean; 59 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.68k op/s 2026-02-18T03:22:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:08 trial119 ceph-mon[24143]: pgmap v236: 33 pgs: 33 active+clean; 59 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.33k op/s 2026-02-18T03:22:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:08 trial114 ceph-mon[23907]: pgmap v236: 33 pgs: 33 active+clean; 59 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.33k op/s 2026-02-18T03:22:09.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:08 trial097 ceph-mon[21799]: pgmap v236: 33 pgs: 33 active+clean; 59 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.33k op/s 2026-02-18T03:22:09.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1648434566' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:09.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1648434566' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:10.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1648434566' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:10 trial119 ceph-mon[24143]: pgmap v237: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.82k op/s 2026-02-18T03:22:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:10 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2040966543' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:10 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1873366864' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:10 trial114 ceph-mon[23907]: pgmap v237: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.82k op/s 2026-02-18T03:22:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:10 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2040966543' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:10 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1873366864' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:11.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:10 trial097 ceph-mon[21799]: pgmap v237: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.82k op/s 2026-02-18T03:22:11.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:10 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2040966543' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:11.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:10 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1873366864' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:12 trial119 ceph-mon[24143]: pgmap v238: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.17k op/s 2026-02-18T03:22:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3765642601' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:12 trial114 ceph-mon[23907]: pgmap v238: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.17k op/s 2026-02-18T03:22:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3765642601' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:13.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:12 trial097 ceph-mon[21799]: pgmap v238: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.17k op/s 2026-02-18T03:22:13.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3765642601' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:13.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:13.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.0M 1.1M 0.0k 10.2M 10.7M 0.0k nvme12n1 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.0M 1.1M 0.0k 10.4M 10.5M 0.0k nvme12n10 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 100.60 1.1M 1.1M 0.0k 10.8M 11.4M 0.0k nvme12n2 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.1M 1.0M 0.0k 10.7M 10.1M 0.0k nvme12n3 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 1.0M 1.0M 0.0k 10.2M 10.4M 0.0k nvme12n4 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.1M 1.0M 0.0k 10.7M 10.2M 0.0k nvme12n5 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.0M 1.1M 0.0k 10.4M 11.0M 0.0k nvme12n6 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 1.1M 1.0M 0.0k 11.4M 10.3M 0.0k nvme12n7 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.0M 1.0M 0.0k 10.1M 10.0M 0.0k nvme12n8 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.0M 977.2k 0.0k 10.3M 9.5M 0.0k nvme12n9 2026-02-18T03:22:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1020.4k 1.0M 0.0k 10.0M 10.1M 0.0k nvme4n1 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 940.4k 1.1M 0.0k 9.2M 10.8M 0.0k nvme4n10 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.1M 1.1M 0.0k 10.9M 10.8M 0.0k nvme4n2 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 98.90 1.1M 1.1M 0.0k 10.7M 11.2M 0.0k nvme4n3 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.1M 1.1M 0.0k 10.6M 11.0M 0.0k nvme4n4 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 98.60 1.1M 1.1M 0.0k 11.3M 11.3M 0.0k nvme4n5 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 941.2k 905.2k 0.0k 9.2M 8.8M 0.0k nvme4n6 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.1M 1.1M 0.0k 10.8M 11.2M 0.0k nvme4n7 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 1001.2k 1.1M 0.0k 9.8M 11.1M 0.0k nvme4n8 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.0M 1.1M 0.0k 10.2M 10.9M 0.0k nvme4n9 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.1M 1.1M 0.0k 10.7M 10.9M 0.0k nvme8n1 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.0M 1.1M 0.0k 10.3M 10.7M 0.0k nvme8n10 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 1.0M 1.0M 0.0k 10.1M 10.1M 0.0k nvme8n2 2026-02-18T03:22:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 99.80 1.2M 1.1M 0.0k 11.6M 10.9M 0.0k nvme8n3 2026-02-18T03:22:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.1M 996.4k 0.0k 10.6M 9.7M 0.0k nvme8n4 2026-02-18T03:22:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.2M 1.1M 0.0k 11.7M 10.7M 0.0k nvme8n5 2026-02-18T03:22:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 1.1M 1.0M 0.0k 10.8M 10.0M 0.0k nvme8n6 2026-02-18T03:22:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.30 1.2M 1.0M 0.0k 11.6M 10.4M 0.0k nvme8n7 2026-02-18T03:22:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.30 1.2M 1.1M 0.0k 11.8M 10.7M 0.0k nvme8n8 2026-02-18T03:22:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 100.10 1.1M 1.2M 0.0k 11.0M 11.9M 0.0k nvme8n9 2026-02-18T03:22:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:13.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:13.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 84.60 926.4k 1018.0k 0.0k 9.0M 9.9M 0.0k nvme12n11 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1.0M 1.1M 0.0k 10.1M 11.2M 0.0k nvme12n12 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.40 1.2M 1.1M 0.0k 11.7M 11.0M 0.0k nvme12n13 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.0M 1.1M 0.0k 10.5M 11.0M 0.0k nvme12n14 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 1.2M 1.1M 0.0k 11.8M 10.9M 0.0k nvme12n15 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.0M 1.0M 0.0k 10.0M 10.2M 0.0k nvme12n16 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.0M 1.1M 0.0k 10.2M 10.8M 0.0k nvme12n17 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.1M 1.0M 0.0k 10.7M 10.4M 0.0k nvme12n18 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.0M 1.0M 0.0k 10.2M 10.1M 0.0k nvme12n19 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 1.1M 1.1M 0.0k 11.4M 10.7M 0.0k nvme12n20 2026-02-18T03:22:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.80 1.1M 1.1M 0.0k 10.7M 10.9M 0.0k nvme4n11 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 99.70 1.2M 1.2M 0.0k 12.3M 11.7M 0.0k nvme4n12 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 982.0k 1.0M 0.0k 9.6M 10.4M 0.0k nvme4n13 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1.0M 1.1M 0.0k 10.1M 11.5M 0.0k nvme4n14 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 1.1M 1.1M 0.0k 10.7M 11.2M 0.0k nvme4n15 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.0M 1.1M 0.0k 10.3M 11.0M 0.0k nvme4n16 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.1M 1.1M 0.0k 10.6M 10.6M 0.0k nvme4n17 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 1.0M 1.1M 0.0k 10.0M 11.4M 0.0k nvme4n18 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 1.1M 1.1M 0.0k 10.7M 11.5M 0.0k nvme4n19 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1021.2k 1.0M 0.0k 10.0M 10.2M 0.0k nvme4n20 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 99.30 1.1M 1.1M 0.0k 10.8M 11.2M 0.0k nvme8n11 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.80 1.1M 1.1M 0.0k 10.7M 10.9M 0.0k nvme8n12 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 1.0M 1.1M 0.0k 10.1M 10.7M 0.0k nvme8n13 2026-02-18T03:22:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.60 1.1M 1.0M 0.0k 10.7M 10.3M 0.0k nvme8n14 2026-02-18T03:22:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.1M 1.0M 0.0k 10.5M 10.4M 0.0k nvme8n15 2026-02-18T03:22:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 1.1M 976.8k 0.0k 10.6M 9.5M 0.0k nvme8n16 2026-02-18T03:22:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 97.70 1.2M 1.0M 0.0k 11.7M 10.5M 0.0k nvme8n17 2026-02-18T03:22:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1.0M 1.1M 0.0k 10.5M 10.5M 0.0k nvme8n18 2026-02-18T03:22:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 1.0M 1.1M 0.0k 10.1M 10.8M 0.0k nvme8n19 2026-02-18T03:22:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 975.2k 1.0M 0.0k 9.5M 10.4M 0.0k nvme8n20 2026-02-18T03:22:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:14 trial119 ceph-mon[24143]: pgmap v239: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 68 MiB/s wr, 6.01k op/s 2026-02-18T03:22:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:14 trial114 ceph-mon[23907]: pgmap v239: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 68 MiB/s wr, 6.01k op/s 2026-02-18T03:22:15.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:14 trial097 ceph-mon[21799]: pgmap v239: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 68 MiB/s wr, 6.01k op/s 2026-02-18T03:22:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:16 trial119 ceph-mon[24143]: pgmap v240: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.74k op/s 2026-02-18T03:22:16.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4032776082' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:16 trial114 ceph-mon[23907]: pgmap v240: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.74k op/s 2026-02-18T03:22:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4032776082' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:17.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:16 trial097 ceph-mon[21799]: pgmap v240: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.74k op/s 2026-02-18T03:22:17.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4032776082' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:17.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:17 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1978386203' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:17.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:17 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3389950541' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:17.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:17 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1978386203' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:17.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:17 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3389950541' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:18.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:17 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1978386203' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:18.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:17 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3389950541' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:18 trial119 ceph-mon[24143]: pgmap v241: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.38k op/s 2026-02-18T03:22:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:18 trial114 ceph-mon[23907]: pgmap v241: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.38k op/s 2026-02-18T03:22:19.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:18 trial097 ceph-mon[21799]: pgmap v241: 33 pgs: 33 active+clean; 59 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.38k op/s 2026-02-18T03:22:19.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1359284106' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:19.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1359284106' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:20.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1359284106' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:20 trial119 ceph-mon[24143]: pgmap v242: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.90k op/s 2026-02-18T03:22:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:20 trial114 ceph-mon[23907]: pgmap v242: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.90k op/s 2026-02-18T03:22:21.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:20 trial097 ceph-mon[21799]: pgmap v242: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.90k op/s 2026-02-18T03:22:22.954 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:22 trial097 ceph-mon[21799]: pgmap v243: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.24k op/s 2026-02-18T03:22:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:22 trial119 ceph-mon[24143]: pgmap v243: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.24k op/s 2026-02-18T03:22:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:22 trial114 ceph-mon[23907]: pgmap v243: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.24k op/s 2026-02-18T03:22:23.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:23.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 1.1M 1.1M 0.0k 10.9M 10.5M 0.0k nvme12n1 2026-02-18T03:22:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.1M 1015.6k 0.0k 10.8M 9.9M 0.0k nvme12n10 2026-02-18T03:22:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.0M 1.1M 0.0k 10.3M 10.8M 0.0k nvme12n2 2026-02-18T03:22:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.90 1.1M 1.0M 0.0k 11.1M 10.2M 0.0k nvme12n3 2026-02-18T03:22:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.60 1.0M 1.1M 0.0k 10.3M 10.6M 0.0k nvme12n4 2026-02-18T03:22:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.20 996.8k 980.0k 0.0k 9.7M 9.6M 0.0k nvme12n5 2026-02-18T03:22:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 956.0k 1001.6k 0.0k 9.3M 9.8M 0.0k nvme12n6 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 101.20 1.1M 1.1M 0.0k 11.4M 10.6M 0.0k nvme12n7 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.60 1.2M 1.0M 0.0k 12.3M 10.4M 0.0k nvme12n8 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1021.2k 1.1M 0.0k 10.0M 11.0M 0.0k nvme12n9 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.1M 984.4k 0.0k 11.3M 9.6M 0.0k nvme4n1 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 1.1M 1.0M 0.0k 10.9M 10.3M 0.0k nvme4n10 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.1M 1.1M 0.0k 11.0M 10.8M 0.0k nvme4n2 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 934.8k 1014.0k 0.0k 9.1M 9.9M 0.0k nvme4n3 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 81.30 903.2k 976.0k 0.0k 8.8M 9.5M 0.0k nvme4n4 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 98.40 1.0M 1.1M 0.0k 10.4M 11.3M 0.0k nvme4n5 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1016.4k 1.1M 0.0k 9.9M 10.6M 0.0k nvme4n6 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 982.0k 1.1M 0.0k 9.6M 11.4M 0.0k nvme4n7 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1005.6k 1.0M 0.0k 9.8M 10.5M 0.0k nvme4n8 2026-02-18T03:22:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 1.1M 1.1M 0.0k 10.6M 10.9M 0.0k nvme4n9 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.0M 1.1M 0.0k 10.1M 10.5M 0.0k nvme8n1 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.20 1.1M 1.1M 0.0k 10.8M 10.9M 0.0k nvme8n10 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 999.2k 1.0M 0.0k 9.8M 10.1M 0.0k nvme8n2 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.90 1.1M 1.0M 0.0k 10.7M 10.4M 0.0k nvme8n3 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 952.0k 1.1M 0.0k 9.3M 10.8M 0.0k nvme8n4 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.1M 1.0M 0.0k 10.8M 10.3M 0.0k nvme8n5 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.0M 1.1M 0.0k 10.0M 10.8M 0.0k nvme8n6 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 1.1M 1.1M 0.0k 10.9M 10.5M 0.0k nvme8n7 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.0M 1.0M 0.0k 10.2M 10.3M 0.0k nvme8n8 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.30 1009.6k 1.0M 0.0k 9.9M 10.5M 0.0k nvme8n9 2026-02-18T03:22:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:23.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2468646525' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:23.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2468646525' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:23.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:23.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.00 1.1M 1.1M 0.0k 10.9M 11.0M 0.0k nvme12n11 2026-02-18T03:22:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 955.6k 1019.6k 0.0k 9.3M 10.0M 0.0k nvme12n12 2026-02-18T03:22:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1.1M 1.1M 0.0k 11.4M 10.7M 0.0k nvme12n13 2026-02-18T03:22:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.0M 1.1M 0.0k 10.3M 10.7M 0.0k nvme12n14 2026-02-18T03:22:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 1.0M 1004.0k 0.0k 10.4M 9.8M 0.0k nvme12n15 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.00 1.1M 1.0M 0.0k 10.7M 10.4M 0.0k nvme12n16 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 1.1M 1022.0k 0.0k 11.1M 10.0M 0.0k nvme12n17 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.1M 1.0M 0.0k 10.7M 10.3M 0.0k nvme12n18 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.0M 1.2M 0.0k 10.5M 11.5M 0.0k nvme12n19 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.40 1.1M 1004.4k 0.0k 11.2M 9.8M 0.0k nvme12n20 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.20 1.2M 1.1M 0.0k 11.9M 10.5M 0.0k nvme4n11 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1.0M 1.1M 0.0k 10.3M 10.7M 0.0k nvme4n12 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 917.6k 1.0M 0.0k 9.0M 10.3M 0.0k nvme4n13 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 1.1M 1.1M 0.0k 10.7M 10.8M 0.0k nvme4n14 2026-02-18T03:22:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 1012.4k 1.0M 0.0k 9.9M 10.2M 0.0k nvme4n15 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.1M 1.0M 0.0k 10.7M 10.3M 0.0k nvme4n16 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 997.6k 1.1M 0.0k 9.7M 10.6M 0.0k nvme4n17 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.0M 1.1M 0.0k 10.3M 11.2M 0.0k nvme4n18 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1.0M 1.1M 0.0k 10.0M 10.9M 0.0k nvme4n19 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 869.6k 1.0M 0.0k 8.5M 10.2M 0.0k nvme4n20 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 1.1M 1.1M 0.0k 10.6M 11.1M 0.0k nvme8n11 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.1M 1.1M 0.0k 11.2M 10.6M 0.0k nvme8n12 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 1.1M 1.0M 0.0k 10.9M 10.3M 0.0k nvme8n13 2026-02-18T03:22:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 985.2k 1.1M 0.0k 9.6M 10.6M 0.0k nvme8n14 2026-02-18T03:22:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1023.6k 1.0M 0.0k 10.0M 10.3M 0.0k nvme8n15 2026-02-18T03:22:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.80 1.0M 1.1M 0.0k 10.1M 10.8M 0.0k nvme8n16 2026-02-18T03:22:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 97.70 1.1M 1.1M 0.0k 11.0M 10.6M 0.0k nvme8n17 2026-02-18T03:22:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 97.40 1.1M 1.1M 0.0k 11.0M 10.9M 0.0k nvme8n18 2026-02-18T03:22:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 1.0M 1.1M 0.0k 10.4M 11.0M 0.0k nvme8n19 2026-02-18T03:22:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.1M 1021.6k 0.0k 10.6M 10.0M 0.0k nvme8n20 2026-02-18T03:22:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:24.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2468646525' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:24 trial119 ceph-mon[24143]: pgmap v244: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 68 MiB/s wr, 6.05k op/s 2026-02-18T03:22:24.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3873481903' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:24.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:24 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3206090276' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:24 trial114 ceph-mon[23907]: pgmap v244: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 68 MiB/s wr, 6.05k op/s 2026-02-18T03:22:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3873481903' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:24.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:24 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3206090276' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:25.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:24 trial097 ceph-mon[21799]: pgmap v244: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s rd, 68 MiB/s wr, 6.05k op/s 2026-02-18T03:22:25.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3873481903' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:25.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:24 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3206090276' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:26 trial119 ceph-mon[24143]: pgmap v245: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.22k op/s 2026-02-18T03:22:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:26 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3274291081' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:26 trial114 ceph-mon[23907]: pgmap v245: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.22k op/s 2026-02-18T03:22:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:26 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3274291081' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:27.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:26 trial097 ceph-mon[21799]: pgmap v245: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.22k op/s 2026-02-18T03:22:27.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:26 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3274291081' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:28 trial119 ceph-mon[24143]: pgmap v246: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.37k op/s 2026-02-18T03:22:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:28 trial114 ceph-mon[23907]: pgmap v246: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.37k op/s 2026-02-18T03:22:29.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:28 trial097 ceph-mon[21799]: pgmap v246: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.37k op/s 2026-02-18T03:22:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:30 trial119 ceph-mon[24143]: pgmap v247: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 66 MiB/s wr, 5.88k op/s 2026-02-18T03:22:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/346346073' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:30 trial114 ceph-mon[23907]: pgmap v247: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 66 MiB/s wr, 5.88k op/s 2026-02-18T03:22:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/346346073' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:31.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:30 trial097 ceph-mon[21799]: pgmap v247: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 66 MiB/s wr, 5.88k op/s 2026-02-18T03:22:31.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/346346073' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:31.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:31 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/502760296' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:31.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:31 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/4161331006' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:31.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:31 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/502760296' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:31.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:31 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/4161331006' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:32.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:31 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/502760296' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:32.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:31 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/4161331006' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:32 trial119 ceph-mon[24143]: pgmap v248: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.21k op/s 2026-02-18T03:22:32.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:32 trial114 ceph-mon[23907]: pgmap v248: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.21k op/s 2026-02-18T03:22:33.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:32 trial097 ceph-mon[21799]: pgmap v248: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.21k op/s 2026-02-18T03:22:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1023.2k 1.0M 0.0k 10.0M 10.1M 0.0k nvme12n1 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.0M 966.8k 0.0k 10.0M 9.4M 0.0k nvme12n10 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 965.2k 1018.0k 0.0k 9.4M 9.9M 0.0k nvme12n2 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.0M 1.1M 0.0k 10.2M 11.2M 0.0k nvme12n3 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 996.8k 1006.0k 0.0k 9.7M 9.8M 0.0k nvme12n4 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.1M 1.0M 0.0k 11.3M 10.2M 0.0k nvme12n5 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 1.1M 1.0M 0.0k 11.2M 10.0M 0.0k nvme12n6 2026-02-18T03:22:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.20 1.0M 1000.8k 0.0k 10.1M 9.8M 0.0k nvme12n7 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 1.0M 1.0M 0.0k 10.1M 10.3M 0.0k nvme12n8 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.10 1001.2k 1.0M 0.0k 9.8M 10.1M 0.0k nvme12n9 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1022.4k 1.0M 0.0k 10.0M 10.1M 0.0k nvme4n1 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.10 952.8k 970.4k 0.0k 9.3M 9.5M 0.0k nvme4n10 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.0M 1.1M 0.0k 10.1M 10.6M 0.0k nvme4n2 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 1.1M 1.0M 0.0k 10.7M 10.5M 0.0k nvme4n3 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.0M 1.1M 0.0k 10.4M 10.8M 0.0k nvme4n4 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1.1M 1.0M 0.0k 11.2M 10.2M 0.0k nvme4n5 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1.1M 1.0M 0.0k 10.8M 10.1M 0.0k nvme4n6 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 993.2k 980.0k 0.0k 9.7M 9.6M 0.0k nvme4n7 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1000.0k 999.6k 0.0k 9.8M 9.8M 0.0k nvme4n8 2026-02-18T03:22:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 998.0k 1.1M 0.0k 9.7M 10.7M 0.0k nvme4n9 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1019.2k 1.0M 0.0k 10.0M 10.1M 0.0k nvme8n1 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.1M 996.4k 0.0k 11.2M 9.7M 0.0k nvme8n10 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1.1M 1.1M 0.0k 11.2M 10.8M 0.0k nvme8n2 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.20 1.1M 1.0M 0.0k 11.1M 10.4M 0.0k nvme8n3 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 962.8k 914.8k 0.0k 9.4M 8.9M 0.0k nvme8n4 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 1.0M 1.0M 0.0k 10.3M 10.2M 0.0k nvme8n5 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1.0M 1006.4k 0.0k 10.2M 9.8M 0.0k nvme8n6 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.60 1.0M 1.0M 0.0k 10.3M 10.5M 0.0k nvme8n7 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.90 1.1M 1.1M 0.0k 10.9M 10.7M 0.0k nvme8n8 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.20 1.0M 1.0M 0.0k 10.4M 10.2M 0.0k nvme8n9 2026-02-18T03:22:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:33.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:33 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3933448653' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:33.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:33 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3933448653' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:33.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:33.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:33.979 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.0M 983.2k 0.0k 10.4M 9.6M 0.0k nvme12n11 2026-02-18T03:22:33.979 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.1M 1.1M 0.0k 10.6M 11.3M 0.0k nvme12n12 2026-02-18T03:22:33.979 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 997.6k 1.1M 0.0k 9.7M 10.9M 0.0k nvme12n13 2026-02-18T03:22:33.979 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 995.6k 980.0k 0.0k 9.7M 9.6M 0.0k nvme12n14 2026-02-18T03:22:33.979 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.1M 1020.0k 0.0k 10.9M 10.0M 0.0k nvme12n15 2026-02-18T03:22:33.979 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1016.4k 982.8k 0.0k 9.9M 9.6M 0.0k nvme12n16 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 1.1M 1.0M 0.0k 11.2M 10.1M 0.0k nvme12n17 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.1M 1.0M 0.0k 11.2M 10.1M 0.0k nvme12n18 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1.1M 1.0M 0.0k 10.5M 10.5M 0.0k nvme12n19 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.0M 1.0M 0.0k 10.5M 10.3M 0.0k nvme12n20 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.0M 1.1M 0.0k 10.1M 10.9M 0.0k nvme4n11 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 100.00 1.1M 1.1M 0.0k 11.1M 10.8M 0.0k nvme4n12 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.0M 1.0M 0.0k 10.0M 10.3M 0.0k nvme4n13 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 992.0k 1.0M 0.0k 9.7M 10.3M 0.0k nvme4n14 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.10 1.1M 1.1M 0.0k 11.0M 10.6M 0.0k nvme4n15 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.1M 1.0M 0.0k 10.5M 10.0M 0.0k nvme4n16 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 925.6k 1.1M 0.0k 9.0M 10.5M 0.0k nvme4n17 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.80 1.1M 1.1M 0.0k 10.6M 11.2M 0.0k nvme4n18 2026-02-18T03:22:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1003.6k 993.2k 0.0k 9.8M 9.7M 0.0k nvme4n19 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.1M 1.0M 0.0k 10.6M 10.0M 0.0k nvme4n20 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 1000.0k 1.1M 0.0k 9.8M 11.1M 0.0k nvme8n11 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 100.60 1.1M 1.1M 0.0k 10.7M 10.8M 0.0k nvme8n12 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1008.8k 995.2k 0.0k 9.9M 9.7M 0.0k nvme8n13 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1007.2k 1.0M 0.0k 9.8M 10.2M 0.0k nvme8n14 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.90 1.1M 1.0M 0.0k 10.7M 10.0M 0.0k nvme8n15 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1022.0k 990.4k 0.0k 10.0M 9.7M 0.0k nvme8n16 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 1.0M 1.0M 0.0k 10.5M 10.3M 0.0k nvme8n17 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 101.90 1.2M 1.1M 0.0k 11.6M 10.6M 0.0k nvme8n18 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 1.0M 1.1M 0.0k 10.4M 10.9M 0.0k nvme8n19 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.1M 1.0M 0.0k 10.6M 10.0M 0.0k nvme8n20 2026-02-18T03:22:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:34.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:33 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3933448653' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:34 trial119 ceph-mon[24143]: pgmap v249: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 67 MiB/s wr, 6.03k op/s 2026-02-18T03:22:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:34 trial114 ceph-mon[23907]: pgmap v249: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 67 MiB/s wr, 6.03k op/s 2026-02-18T03:22:35.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:34 trial097 ceph-mon[21799]: pgmap v249: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 67 MiB/s wr, 6.03k op/s 2026-02-18T03:22:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:36 trial119 ceph-mon[24143]: pgmap v250: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.22k op/s 2026-02-18T03:22:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:36 trial114 ceph-mon[23907]: pgmap v250: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.22k op/s 2026-02-18T03:22:37.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:36 trial097 ceph-mon[21799]: pgmap v250: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.22k op/s 2026-02-18T03:22:37.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4288421690' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:37.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4288421690' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:38.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4288421690' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:38 trial119 ceph-mon[24143]: pgmap v251: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 5.89k op/s 2026-02-18T03:22:38.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:38 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/35379237' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:38.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:38 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1048194122' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:38 trial114 ceph-mon[23907]: pgmap v251: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 5.89k op/s 2026-02-18T03:22:38.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:38 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/35379237' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:38.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:38 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1048194122' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:39.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:38 trial097 ceph-mon[21799]: pgmap v251: 33 pgs: 33 active+clean; 59 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 5.89k op/s 2026-02-18T03:22:39.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:38 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/35379237' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:39.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:38 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1048194122' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:40 trial119 ceph-mon[24143]: pgmap v252: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 64 MiB/s wr, 5.88k op/s 2026-02-18T03:22:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:40 trial114 ceph-mon[23907]: pgmap v252: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 64 MiB/s wr, 5.88k op/s 2026-02-18T03:22:41.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:40 trial097 ceph-mon[21799]: pgmap v252: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 64 MiB/s wr, 5.88k op/s 2026-02-18T03:22:41.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/484248395' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:42.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/484248395' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:42.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/484248395' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:42.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:42 trial114 ceph-mon[23907]: pgmap v253: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 57 MiB/s wr, 5.22k op/s 2026-02-18T03:22:43.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:42 trial097 ceph-mon[21799]: pgmap v253: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 57 MiB/s wr, 5.22k op/s 2026-02-18T03:22:43.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:42 trial119 ceph-mon[24143]: pgmap v253: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 57 MiB/s wr, 5.22k op/s 2026-02-18T03:22:43.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 82.10 821.6k 1003.6k 0.0k 8.0M 9.8M 0.0k nvme12n1 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.0M 970.8k 0.0k 10.4M 9.5M 0.0k nvme12n10 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 97.70 1.1M 1.1M 0.0k 11.3M 10.6M 0.0k nvme12n2 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.0M 1019.6k 0.0k 10.1M 10.0M 0.0k nvme12n3 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 930.4k 929.6k 0.0k 9.1M 9.1M 0.0k nvme12n4 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.0M 969.6k 0.0k 10.0M 9.5M 0.0k nvme12n5 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1006.4k 1.0M 0.0k 9.8M 10.1M 0.0k nvme12n6 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1016.4k 1.1M 0.0k 9.9M 10.7M 0.0k nvme12n7 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.0M 934.0k 0.0k 10.2M 9.1M 0.0k nvme12n8 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 1.0M 990.4k 0.0k 10.5M 9.7M 0.0k nvme12n9 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.1M 1.1M 0.0k 10.9M 10.6M 0.0k nvme4n1 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.1M 963.6k 0.0k 10.7M 9.4M 0.0k nvme4n10 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.1M 1019.2k 0.0k 10.6M 10.0M 0.0k nvme4n2 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.0M 1.0M 0.0k 10.2M 10.2M 0.0k nvme4n3 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1015.6k 1.0M 0.0k 9.9M 10.2M 0.0k nvme4n4 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 97.40 1021.6k 1.1M 0.0k 10.0M 10.9M 0.0k nvme4n5 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 1017.6k 985.2k 0.0k 9.9M 9.6M 0.0k nvme4n6 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.0M 1.0M 0.0k 10.1M 10.2M 0.0k nvme4n7 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 970.4k 1.0M 0.0k 9.5M 10.2M 0.0k nvme4n8 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1021.2k 997.2k 0.0k 10.0M 9.7M 0.0k nvme4n9 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 978.8k 1.1M 0.0k 9.6M 11.0M 0.0k nvme8n1 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 1.1M 1.0M 0.0k 11.5M 10.0M 0.0k nvme8n10 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 942.8k 1012.0k 0.0k 9.2M 9.9M 0.0k nvme8n2 2026-02-18T03:22:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 99.80 1.2M 1.1M 0.0k 12.1M 10.7M 0.0k nvme8n3 2026-02-18T03:22:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 97.10 1.1M 1.0M 0.0k 10.8M 10.2M 0.0k nvme8n4 2026-02-18T03:22:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.0M 974.8k 0.0k 10.3M 9.5M 0.0k nvme8n5 2026-02-18T03:22:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.0M 1.1M 0.0k 10.3M 10.7M 0.0k nvme8n6 2026-02-18T03:22:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 1.0M 986.8k 0.0k 10.3M 9.6M 0.0k nvme8n7 2026-02-18T03:22:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.1M 1012.8k 0.0k 10.7M 9.9M 0.0k nvme8n8 2026-02-18T03:22:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 99.20 1.0M 1.1M 0.0k 10.1M 10.9M 0.0k nvme8n9 2026-02-18T03:22:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:43.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:43 trial114 ceph-mon[23907]: pgmap v254: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 6.05k op/s 2026-02-18T03:22:43.979 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:43.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:43.979 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 909.2k 1.1M 0.0k 8.9M 10.7M 0.0k nvme12n11 2026-02-18T03:22:43.979 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 1019.2k 1.0M 0.0k 10.0M 10.1M 0.0k nvme12n12 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1.0M 1.0M 0.0k 10.2M 10.1M 0.0k nvme12n13 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 1.1M 1.0M 0.0k 10.9M 10.0M 0.0k nvme12n14 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 962.8k 1.0M 0.0k 9.4M 10.4M 0.0k nvme12n15 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1.0M 1000.8k 0.0k 10.3M 9.8M 0.0k nvme12n16 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 991.2k 978.8k 0.0k 9.7M 9.6M 0.0k nvme12n17 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 1.0M 1.0M 0.0k 10.5M 10.1M 0.0k nvme12n18 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.1M 1011.2k 0.0k 10.5M 9.9M 0.0k nvme12n19 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1023.6k 1.0M 0.0k 10.0M 10.3M 0.0k nvme12n20 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.0M 938.0k 0.0k 10.3M 9.2M 0.0k nvme4n11 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 101.20 1.1M 1.0M 0.0k 10.9M 10.4M 0.0k nvme4n12 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 86.00 974.8k 938.0k 0.0k 9.5M 9.2M 0.0k nvme4n13 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.70 1.0M 1.0M 0.0k 10.2M 10.2M 0.0k nvme4n14 2026-02-18T03:22:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.0M 1.0M 0.0k 10.1M 10.2M 0.0k nvme4n15 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 990.0k 1.1M 0.0k 9.7M 10.6M 0.0k nvme4n16 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 951.6k 981.6k 0.0k 9.3M 9.6M 0.0k nvme4n17 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.0M 1016.4k 0.0k 10.2M 9.9M 0.0k nvme4n18 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 974.0k 1.0M 0.0k 9.5M 10.2M 0.0k nvme4n19 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.0M 998.8k 0.0k 10.1M 9.8M 0.0k nvme4n20 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.90 1.1M 1.0M 0.0k 10.6M 10.4M 0.0k nvme8n11 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.60 1.1M 1.1M 0.0k 10.9M 11.2M 0.0k nvme8n12 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 1.2M 1.0M 0.0k 11.5M 10.3M 0.0k nvme8n13 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.1M 965.2k 0.0k 11.0M 9.4M 0.0k nvme8n14 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.70 1.1M 1018.4k 0.0k 10.6M 9.9M 0.0k nvme8n15 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1014.4k 1.0M 0.0k 9.9M 10.4M 0.0k nvme8n16 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.00 1.0M 1012.0k 0.0k 10.4M 9.9M 0.0k nvme8n17 2026-02-18T03:22:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 988.0k 1.1M 0.0k 9.6M 10.6M 0.0k nvme8n18 2026-02-18T03:22:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 992.8k 1.0M 0.0k 9.7M 10.3M 0.0k nvme8n19 2026-02-18T03:22:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1.1M 962.8k 0.0k 10.6M 9.4M 0.0k nvme8n20 2026-02-18T03:22:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:44.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:43 trial097 ceph-mon[21799]: pgmap v254: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 6.05k op/s 2026-02-18T03:22:44.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:43 trial119 ceph-mon[24143]: pgmap v254: 33 pgs: 33 active+clean; 59 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 6.05k op/s 2026-02-18T03:22:44.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2943742937' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:45.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2943742937' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:45.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2943742937' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:45.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1828867378' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:45.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:45 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2289043636' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:45.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:45 trial114 ceph-mon[23907]: pgmap v255: 33 pgs: 33 active+clean; 59 GiB data, 63 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.23k op/s 2026-02-18T03:22:46.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1828867378' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:46.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:45 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2289043636' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:46.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:45 trial097 ceph-mon[21799]: pgmap v255: 33 pgs: 33 active+clean; 59 GiB data, 63 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.23k op/s 2026-02-18T03:22:46.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1828867378' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:46.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:45 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2289043636' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:46.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:45 trial119 ceph-mon[24143]: pgmap v255: 33 pgs: 33 active+clean; 59 GiB data, 63 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.23k op/s 2026-02-18T03:22:48.901 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:48 trial097 ceph-mon[21799]: pgmap v256: 33 pgs: 33 active+clean; 59 GiB data, 63 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.90k op/s 2026-02-18T03:22:48.901 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/849600233' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:48 trial119 ceph-mon[24143]: pgmap v256: 33 pgs: 33 active+clean; 59 GiB data, 63 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.90k op/s 2026-02-18T03:22:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/849600233' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:48 trial114 ceph-mon[23907]: pgmap v256: 33 pgs: 33 active+clean; 59 GiB data, 63 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.90k op/s 2026-02-18T03:22:48.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/849600233' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:50.901 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:50 trial097 ceph-mon[21799]: pgmap v257: 33 pgs: 33 active+clean; 59 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.89k op/s 2026-02-18T03:22:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:50 trial119 ceph-mon[24143]: pgmap v257: 33 pgs: 33 active+clean; 59 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.89k op/s 2026-02-18T03:22:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:50 trial114 ceph-mon[23907]: pgmap v257: 33 pgs: 33 active+clean; 59 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.89k op/s 2026-02-18T03:22:51.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:51 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3909497190' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:51.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:51 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3909497190' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:51.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:51 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3909497190' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:52.801 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:52 trial097 ceph-mon[21799]: pgmap v258: 33 pgs: 33 active+clean; 59 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.22k op/s 2026-02-18T03:22:52.801 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:52 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1544214052' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:52.801 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:52 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3820757905' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:52 trial119 ceph-mon[24143]: pgmap v258: 33 pgs: 33 active+clean; 59 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.22k op/s 2026-02-18T03:22:52.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:52 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1544214052' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:52.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:52 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3820757905' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:52 trial114 ceph-mon[23907]: pgmap v258: 33 pgs: 33 active+clean; 59 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.22k op/s 2026-02-18T03:22:52.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:52 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1544214052' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:52.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:52 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3820757905' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:53.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:53.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.0M 951.2k 0.0k 10.2M 9.3M 0.0k nvme12n1 2026-02-18T03:22:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 933.6k 1011.2k 0.0k 9.1M 9.9M 0.0k nvme12n10 2026-02-18T03:22:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 973.6k 965.6k 0.0k 9.5M 9.4M 0.0k nvme12n2 2026-02-18T03:22:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.0M 995.6k 0.0k 10.1M 9.7M 0.0k nvme12n3 2026-02-18T03:22:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.1M 1016.0k 0.0k 10.7M 9.9M 0.0k nvme12n4 2026-02-18T03:22:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 83.80 874.4k 958.4k 0.0k 8.5M 9.4M 0.0k nvme12n5 2026-02-18T03:22:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.0M 1.1M 0.0k 10.4M 10.8M 0.0k nvme12n6 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 1.0M 1.0M 0.0k 10.1M 10.1M 0.0k nvme12n7 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 892.8k 918.8k 0.0k 8.7M 9.0M 0.0k nvme12n8 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1.1M 1.0M 0.0k 11.4M 10.4M 0.0k nvme12n9 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.80 965.6k 941.6k 0.0k 9.4M 9.2M 0.0k nvme4n1 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 894.8k 1.1M 0.0k 8.7M 10.7M 0.0k nvme4n10 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 970.8k 983.2k 0.0k 9.5M 9.6M 0.0k nvme4n2 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 98.10 1.1M 1.0M 0.0k 10.8M 10.3M 0.0k nvme4n3 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.0M 1020.4k 0.0k 10.1M 10.0M 0.0k nvme4n4 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.40 1.1M 1.0M 0.0k 11.0M 10.1M 0.0k nvme4n5 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 1020.8k 1.1M 0.0k 10.0M 10.7M 0.0k nvme4n6 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1001.2k 993.6k 0.0k 9.8M 9.7M 0.0k nvme4n7 2026-02-18T03:22:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 960.8k 964.0k 0.0k 9.4M 9.4M 0.0k nvme4n8 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 897.6k 1.0M 0.0k 8.8M 10.3M 0.0k nvme4n9 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 1007.6k 1.0M 0.0k 9.8M 10.1M 0.0k nvme8n1 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 970.0k 959.6k 0.0k 9.5M 9.4M 0.0k nvme8n10 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1.1M 1.1M 0.0k 10.8M 10.6M 0.0k nvme8n2 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 102.80 1.1M 1.0M 0.0k 11.3M 10.4M 0.0k nvme8n3 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 922.4k 1017.6k 0.0k 9.0M 9.9M 0.0k nvme8n4 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.20 940.0k 1014.0k 0.0k 9.2M 9.9M 0.0k nvme8n5 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 856.4k 966.8k 0.0k 8.4M 9.4M 0.0k nvme8n6 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 1.0M 1.0M 0.0k 10.2M 10.1M 0.0k nvme8n7 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.90 918.4k 978.8k 0.0k 9.0M 9.6M 0.0k nvme8n8 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.0M 1.0M 0.0k 10.4M 10.3M 0.0k nvme8n9 2026-02-18T03:22:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:22:53.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.0M 992.0k 0.0k 10.1M 9.7M 0.0k nvme12n11 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.0M 1014.0k 0.0k 10.4M 9.9M 0.0k nvme12n12 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.1M 1.0M 0.0k 10.6M 10.2M 0.0k nvme12n13 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1.1M 1.0M 0.0k 11.3M 10.4M 0.0k nvme12n14 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 94.60 1010.0k 964.0k 0.0k 9.9M 9.4M 0.0k nvme12n15 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 967.2k 1.0M 0.0k 9.4M 10.5M 0.0k nvme12n16 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 1014.4k 1.1M 0.0k 9.9M 10.7M 0.0k nvme12n17 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 1003.6k 893.6k 0.0k 9.8M 8.7M 0.0k nvme12n18 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.0M 988.4k 0.0k 10.5M 9.7M 0.0k nvme12n19 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 940.8k 1.0M 0.0k 9.2M 10.1M 0.0k nvme12n20 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 97.60 1014.8k 991.6k 0.0k 9.9M 9.7M 0.0k nvme4n11 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 911.2k 1.1M 0.0k 8.9M 10.6M 0.0k nvme4n12 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 86.00 906.0k 1018.0k 0.0k 8.8M 9.9M 0.0k nvme4n13 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 1020.8k 998.8k 0.0k 10.0M 9.8M 0.0k nvme4n14 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 1.0M 1008.8k 0.0k 10.3M 9.9M 0.0k nvme4n15 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 97.00 1.0M 1001.6k 0.0k 10.1M 9.8M 0.0k nvme4n16 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.1M 983.6k 0.0k 10.6M 9.6M 0.0k nvme4n17 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 951.2k 998.0k 0.0k 9.3M 9.7M 0.0k nvme4n18 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 924.0k 998.4k 0.0k 9.0M 9.8M 0.0k nvme4n19 2026-02-18T03:22:53.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.20 1.0M 959.2k 0.0k 10.4M 9.4M 0.0k nvme4n20 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.60 1.0M 1.1M 0.0k 10.4M 10.7M 0.0k nvme8n11 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.00 1.0M 1017.6k 0.0k 10.2M 9.9M 0.0k nvme8n12 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.1M 1014.8k 0.0k 10.7M 9.9M 0.0k nvme8n13 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 980.0k 1.0M 0.0k 9.6M 10.4M 0.0k nvme8n14 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 919.2k 971.6k 0.0k 9.0M 9.5M 0.0k nvme8n15 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 908.8k 1.0M 0.0k 8.9M 10.1M 0.0k nvme8n16 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 1.0M 1020.8k 0.0k 10.1M 10.0M 0.0k nvme8n17 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 1017.6k 1.0M 0.0k 9.9M 10.4M 0.0k nvme8n18 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.70 1.1M 1.0M 0.0k 10.7M 10.4M 0.0k nvme8n19 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 1.1M 1.0M 0.0k 11.1M 10.1M 0.0k nvme8n20 2026-02-18T03:22:53.977 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:22:54.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:54 trial097 ceph-mon[21799]: pgmap v259: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 6.02k op/s 2026-02-18T03:22:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:54 trial119 ceph-mon[24143]: pgmap v259: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 6.02k op/s 2026-02-18T03:22:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:54 trial114 ceph-mon[23907]: pgmap v259: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 6.02k op/s 2026-02-18T03:22:55.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1346558253' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1346558253' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:55.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1346558253' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:56.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:56 trial097 ceph-mon[21799]: pgmap v260: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.20k op/s 2026-02-18T03:22:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:56 trial119 ceph-mon[24143]: pgmap v260: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.20k op/s 2026-02-18T03:22:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:56 trial114 ceph-mon[23907]: pgmap v260: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.20k op/s 2026-02-18T03:22:58.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:58 trial097 ceph-mon[21799]: pgmap v261: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:22:58.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3124280366' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:58 trial119 ceph-mon[24143]: pgmap v261: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:22:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3124280366' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:58 trial114 ceph-mon[23907]: pgmap v261: 33 pgs: 33 active+clean; 59 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:22:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3124280366' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:59.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:59 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2208833565' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:59.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:22:59 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2928356656' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:59 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2208833565' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:59.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:22:59 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2928356656' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:59 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2208833565' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:22:59.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:22:59 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2928356656' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:00.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:00 trial097 ceph-mon[21799]: pgmap v262: 33 pgs: 33 active+clean; 59 GiB data, 66 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:23:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:00 trial119 ceph-mon[24143]: pgmap v262: 33 pgs: 33 active+clean; 59 GiB data, 66 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:23:00.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:00 trial114 ceph-mon[23907]: pgmap v262: 33 pgs: 33 active+clean; 59 GiB data, 66 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:23:01.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:23:01.901 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:23:01.901 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:23:01.901 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:23:01.901 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:23:01.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:23:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:23:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:23:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:23:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:23:01.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:23:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:23:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:23:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:23:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:23:02.874 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:02 trial114 ceph-mon[23907]: pgmap v263: 33 pgs: 33 active+clean; 59 GiB data, 66 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.21k op/s 2026-02-18T03:23:02.874 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2439255882' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:02.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:02 trial097 ceph-mon[21799]: pgmap v263: 33 pgs: 33 active+clean; 59 GiB data, 66 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.21k op/s 2026-02-18T03:23:02.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2439255882' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:02 trial119 ceph-mon[24143]: pgmap v263: 33 pgs: 33 active+clean; 59 GiB data, 66 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.21k op/s 2026-02-18T03:23:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2439255882' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:03.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:03.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 85.30 866.8k 984.0k 0.0k 8.5M 9.6M 0.0k nvme12n1 2026-02-18T03:23:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 883.6k 992.8k 0.0k 8.6M 9.7M 0.0k nvme12n10 2026-02-18T03:23:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 1.0M 1.0M 0.0k 10.1M 10.3M 0.0k nvme12n2 2026-02-18T03:23:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.0M 956.4k 0.0k 10.1M 9.3M 0.0k nvme12n3 2026-02-18T03:23:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.0M 960.8k 0.0k 10.5M 9.4M 0.0k nvme12n4 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1000.8k 894.0k 0.0k 9.8M 8.7M 0.0k nvme12n5 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 887.6k 994.8k 0.0k 8.7M 9.7M 0.0k nvme12n6 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 1.0M 1.0M 0.0k 10.1M 10.2M 0.0k nvme12n7 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.70 1015.2k 950.0k 0.0k 9.9M 9.3M 0.0k nvme12n8 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.00 997.2k 950.8k 0.0k 9.7M 9.3M 0.0k nvme12n9 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.0M 1.0M 0.0k 10.4M 10.0M 0.0k nvme4n1 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 1.0M 1.0M 0.0k 10.4M 10.1M 0.0k nvme4n10 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 895.2k 998.0k 0.0k 8.7M 9.7M 0.0k nvme4n2 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.60 1014.4k 1.0M 0.0k 9.9M 10.1M 0.0k nvme4n3 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 794.0k 1.0M 0.0k 7.8M 10.3M 0.0k nvme4n4 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 1.1M 932.0k 0.0k 11.3M 9.1M 0.0k nvme4n5 2026-02-18T03:23:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 984.8k 976.4k 0.0k 9.6M 9.5M 0.0k nvme4n6 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.0M 1.0M 0.0k 10.2M 10.5M 0.0k nvme4n7 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.80 932.8k 980.0k 0.0k 9.1M 9.6M 0.0k nvme4n8 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 950.0k 939.6k 0.0k 9.3M 9.2M 0.0k nvme4n9 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.0M 1.0M 0.0k 10.0M 10.3M 0.0k nvme8n1 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.1M 1.0M 0.0k 10.7M 10.0M 0.0k nvme8n10 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 1.0M 976.4k 0.0k 10.4M 9.5M 0.0k nvme8n2 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.40 1.0M 1.0M 0.0k 10.5M 10.1M 0.0k nvme8n3 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.00 1008.8k 1.0M 0.0k 9.9M 10.3M 0.0k nvme8n4 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 979.2k 996.8k 0.0k 9.6M 9.7M 0.0k nvme8n5 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 82.80 863.2k 942.8k 0.0k 8.4M 9.2M 0.0k nvme8n6 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.20 1.0M 986.8k 0.0k 10.2M 9.6M 0.0k nvme8n7 2026-02-18T03:23:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 971.6k 990.0k 0.0k 9.5M 9.7M 0.0k nvme8n8 2026-02-18T03:23:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 100.30 1.0M 1.0M 0.0k 10.4M 10.3M 0.0k nvme8n9 2026-02-18T03:23:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:03.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:03.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 969.6k 1.0M 0.0k 9.5M 10.2M 0.0k nvme12n11 2026-02-18T03:23:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1000.8k 950.4k 0.0k 9.8M 9.3M 0.0k nvme12n12 2026-02-18T03:23:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1.1M 1022.8k 0.0k 10.9M 10.0M 0.0k nvme12n13 2026-02-18T03:23:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.0M 968.4k 0.0k 10.5M 9.5M 0.0k nvme12n14 2026-02-18T03:23:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1019.2k 901.6k 0.0k 10.0M 8.8M 0.0k nvme12n15 2026-02-18T03:23:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 942.8k 970.4k 0.0k 9.2M 9.5M 0.0k nvme12n16 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 1017.2k 1019.2k 0.0k 9.9M 10.0M 0.0k nvme12n17 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 922.8k 935.2k 0.0k 9.0M 9.1M 0.0k nvme12n18 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.0M 971.6k 0.0k 10.2M 9.5M 0.0k nvme12n19 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.80 1.0M 1.1M 0.0k 10.3M 10.6M 0.0k nvme12n20 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 995.6k 991.6k 0.0k 9.7M 9.7M 0.0k nvme4n11 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 978.8k 980.4k 0.0k 9.6M 9.6M 0.0k nvme4n12 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.40 1.0M 956.0k 0.0k 10.2M 9.3M 0.0k nvme4n13 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 843.2k 1.1M 0.0k 8.2M 10.9M 0.0k nvme4n14 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.00 1.1M 984.8k 0.0k 11.4M 9.6M 0.0k nvme4n15 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 968.4k 1.0M 0.0k 9.5M 10.2M 0.0k nvme4n16 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 914.4k 907.2k 0.0k 8.9M 8.9M 0.0k nvme4n17 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 944.8k 987.6k 0.0k 9.2M 9.6M 0.0k nvme4n18 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 1.0M 982.8k 0.0k 10.1M 9.6M 0.0k nvme4n19 2026-02-18T03:23:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 843.6k 1.1M 0.0k 8.2M 10.6M 0.0k nvme4n20 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 104.70 1.2M 1.1M 0.0k 12.2M 10.6M 0.0k nvme8n11 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 100.20 1.1M 1.1M 0.0k 10.6M 10.9M 0.0k nvme8n12 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 1.0M 957.2k 0.0k 10.1M 9.3M 0.0k nvme8n13 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 924.0k 1.0M 0.0k 9.0M 10.1M 0.0k nvme8n14 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 910.8k 923.6k 0.0k 8.9M 9.0M 0.0k nvme8n15 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 983.2k 1.0M 0.0k 9.6M 10.5M 0.0k nvme8n16 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.0M 1010.0k 0.0k 10.4M 9.9M 0.0k nvme8n17 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.1M 977.2k 0.0k 10.8M 9.5M 0.0k nvme8n18 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 948.0k 1.0M 0.0k 9.3M 10.4M 0.0k nvme8n19 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 932.0k 936.0k 0.0k 9.1M 9.1M 0.0k nvme8n20 2026-02-18T03:23:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:04.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:04 trial097 ceph-mon[21799]: pgmap v264: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 6.02k op/s 2026-02-18T03:23:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:04 trial119 ceph-mon[24143]: pgmap v264: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 6.02k op/s 2026-02-18T03:23:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:04 trial114 ceph-mon[23907]: pgmap v264: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 6.02k op/s 2026-02-18T03:23:05.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:05 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/574396063' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:05.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:05 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/574396063' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:05.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:05 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/574396063' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:06.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:06 trial097 ceph-mon[21799]: pgmap v265: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.22k op/s 2026-02-18T03:23:06.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:06 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3599978109' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:06.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:06 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1044999278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:06 trial119 ceph-mon[24143]: pgmap v265: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.22k op/s 2026-02-18T03:23:06.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:06 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3599978109' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:06.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:06 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1044999278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:06 trial114 ceph-mon[23907]: pgmap v265: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.22k op/s 2026-02-18T03:23:06.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:06 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3599978109' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:06.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:06 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1044999278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:08.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:08 trial097 ceph-mon[21799]: pgmap v266: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.88k op/s 2026-02-18T03:23:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:08 trial119 ceph-mon[24143]: pgmap v266: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.88k op/s 2026-02-18T03:23:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:08 trial114 ceph-mon[23907]: pgmap v266: 33 pgs: 33 active+clean; 59 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.88k op/s 2026-02-18T03:23:09.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/506376078' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:09.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/506376078' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:09.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/506376078' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:10.865 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:10 trial119 ceph-mon[24143]: pgmap v267: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:23:10.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:10 trial097 ceph-mon[21799]: pgmap v267: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:23:10.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:10 trial114 ceph-mon[23907]: pgmap v267: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 62 MiB/s wr, 5.87k op/s 2026-02-18T03:23:12.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:12 trial097 ceph-mon[21799]: pgmap v268: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 55 MiB/s wr, 5.19k op/s 2026-02-18T03:23:12.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2995625147' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:12 trial119 ceph-mon[24143]: pgmap v268: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 55 MiB/s wr, 5.19k op/s 2026-02-18T03:23:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2995625147' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:12 trial114 ceph-mon[23907]: pgmap v268: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 55 MiB/s wr, 5.19k op/s 2026-02-18T03:23:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2995625147' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:13.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:13.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 952.4k 988.4k 0.0k 9.3M 9.7M 0.0k nvme12n1 2026-02-18T03:23:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 948.8k 985.2k 0.0k 9.3M 9.6M 0.0k nvme12n10 2026-02-18T03:23:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 99.00 1.0M 1.0M 0.0k 10.4M 10.2M 0.0k nvme12n2 2026-02-18T03:23:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 929.6k 1020.4k 0.0k 9.1M 10.0M 0.0k nvme12n3 2026-02-18T03:23:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.0M 976.8k 0.0k 10.1M 9.5M 0.0k nvme12n4 2026-02-18T03:23:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.80 964.8k 855.2k 0.0k 9.4M 8.4M 0.0k nvme12n5 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1020.4k 962.0k 0.0k 10.0M 9.4M 0.0k nvme12n6 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.60 1.0M 988.8k 0.0k 10.2M 9.7M 0.0k nvme12n7 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.00 1.1M 968.0k 0.0k 10.7M 9.5M 0.0k nvme12n8 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.00 890.8k 941.6k 0.0k 8.7M 9.2M 0.0k nvme12n9 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 910.0k 956.8k 0.0k 8.9M 9.3M 0.0k nvme4n1 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.0M 999.6k 0.0k 10.4M 9.8M 0.0k nvme4n10 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.60 1012.0k 1.0M 0.0k 9.9M 10.1M 0.0k nvme4n2 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 1.0M 962.0k 0.0k 10.1M 9.4M 0.0k nvme4n3 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.00 949.6k 899.2k 0.0k 9.3M 8.8M 0.0k nvme4n4 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.90 957.6k 1.0M 0.0k 9.4M 10.3M 0.0k nvme4n5 2026-02-18T03:23:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 876.8k 919.2k 0.0k 8.6M 9.0M 0.0k nvme4n6 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 1008.4k 966.4k 0.0k 9.8M 9.4M 0.0k nvme4n7 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 937.2k 971.6k 0.0k 9.2M 9.5M 0.0k nvme4n8 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 963.6k 981.6k 0.0k 9.4M 9.6M 0.0k nvme4n9 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 101.20 1.2M 1023.2k 0.0k 11.9M 10.0M 0.0k nvme8n1 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.60 1.0M 1.1M 0.0k 10.3M 10.6M 0.0k nvme8n10 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 944.8k 1.0M 0.0k 9.2M 10.0M 0.0k nvme8n2 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.1M 1.0M 0.0k 10.8M 10.5M 0.0k nvme8n3 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.0M 1009.6k 0.0k 10.0M 9.9M 0.0k nvme8n4 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 98.40 1.1M 1008.0k 0.0k 10.8M 9.8M 0.0k nvme8n5 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.0M 970.4k 0.0k 10.1M 9.5M 0.0k nvme8n6 2026-02-18T03:23:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.90 998.0k 968.8k 0.0k 9.7M 9.5M 0.0k nvme8n7 2026-02-18T03:23:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.1M 1003.2k 0.0k 10.7M 9.8M 0.0k nvme8n8 2026-02-18T03:23:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 99.60 1012.8k 1.0M 0.0k 9.9M 10.3M 0.0k nvme8n9 2026-02-18T03:23:13.503 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:13.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3944059437' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:13.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3498977338' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:13.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3944059437' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:13.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3498977338' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:13.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3944059437' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:13.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3498977338' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:13.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:13.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 946.8k 1001.2k 0.0k 9.2M 9.8M 0.0k nvme12n11 2026-02-18T03:23:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 982.8k 1.0M 0.0k 9.6M 10.1M 0.0k nvme12n12 2026-02-18T03:23:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 996.0k 1.0M 0.0k 9.7M 10.3M 0.0k nvme12n13 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 1.1M 1.0M 0.0k 10.7M 10.1M 0.0k nvme12n14 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 84.00 865.2k 914.0k 0.0k 8.4M 8.9M 0.0k nvme12n15 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 999.2k 1.0M 0.0k 9.8M 10.0M 0.0k nvme12n16 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.00 1.0M 1.1M 0.0k 10.4M 10.8M 0.0k nvme12n17 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.40 924.0k 868.4k 0.0k 9.0M 8.5M 0.0k nvme12n18 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 955.6k 1.0M 0.0k 9.3M 10.0M 0.0k nvme12n19 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 932.4k 1006.4k 0.0k 9.1M 9.8M 0.0k nvme12n20 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 969.2k 1014.8k 0.0k 9.5M 9.9M 0.0k nvme4n11 2026-02-18T03:23:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 988.8k 1011.2k 0.0k 9.7M 9.9M 0.0k nvme4n12 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 1.0M 1.0M 0.0k 10.2M 10.0M 0.0k nvme4n13 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 1.0M 1010.8k 0.0k 10.4M 9.9M 0.0k nvme4n14 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 934.0k 974.8k 0.0k 9.1M 9.5M 0.0k nvme4n15 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 1002.4k 1.1M 0.0k 9.8M 10.7M 0.0k nvme4n16 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.0M 1.0M 0.0k 10.2M 10.1M 0.0k nvme4n17 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 966.4k 979.2k 0.0k 9.4M 9.6M 0.0k nvme4n18 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1009.6k 967.2k 0.0k 9.9M 9.4M 0.0k nvme4n19 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.0M 964.8k 0.0k 10.0M 9.4M 0.0k nvme4n20 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 100.30 1.0M 1.1M 0.0k 10.4M 10.6M 0.0k nvme8n11 2026-02-18T03:23:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.80 997.6k 1.0M 0.0k 9.7M 10.4M 0.0k nvme8n12 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1003.6k 960.4k 0.0k 9.8M 9.4M 0.0k nvme8n13 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 1.1M 1.0M 0.0k 10.6M 10.4M 0.0k nvme8n14 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 962.8k 921.6k 0.0k 9.4M 9.0M 0.0k nvme8n15 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 86.60 1016.0k 950.4k 0.0k 9.9M 9.3M 0.0k nvme8n16 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 984.0k 971.2k 0.0k 9.6M 9.5M 0.0k nvme8n17 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 978.8k 988.8k 0.0k 9.6M 9.7M 0.0k nvme8n18 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.1M 1.0M 0.0k 10.5M 10.0M 0.0k nvme8n19 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.0M 958.8k 0.0k 10.2M 9.4M 0.0k nvme8n20 2026-02-18T03:23:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:14.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:14 trial097 ceph-mon[21799]: pgmap v269: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 6.01k op/s 2026-02-18T03:23:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:14 trial119 ceph-mon[24143]: pgmap v269: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 6.01k op/s 2026-02-18T03:23:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:14 trial114 ceph-mon[23907]: pgmap v269: 33 pgs: 33 active+clean; 59 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 6.01k op/s 2026-02-18T03:23:16.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:16 trial097 ceph-mon[21799]: pgmap v270: 33 pgs: 33 active+clean; 59 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.20k op/s 2026-02-18T03:23:16.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3386519958' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:16 trial119 ceph-mon[24143]: pgmap v270: 33 pgs: 33 active+clean; 59 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.20k op/s 2026-02-18T03:23:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3386519958' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:16 trial114 ceph-mon[23907]: pgmap v270: 33 pgs: 33 active+clean; 59 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.20k op/s 2026-02-18T03:23:16.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3386519958' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:18.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:18 trial097 ceph-mon[21799]: pgmap v271: 33 pgs: 33 active+clean; 59 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 61 MiB/s wr, 5.85k op/s 2026-02-18T03:23:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:18 trial119 ceph-mon[24143]: pgmap v271: 33 pgs: 33 active+clean; 59 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 61 MiB/s wr, 5.85k op/s 2026-02-18T03:23:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:18 trial114 ceph-mon[23907]: pgmap v271: 33 pgs: 33 active+clean; 59 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 61 MiB/s wr, 5.85k op/s 2026-02-18T03:23:19.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4250756096' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:19.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4250756096' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:19.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4250756096' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:20.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:20 trial097 ceph-mon[21799]: pgmap v272: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 60 MiB/s wr, 5.83k op/s 2026-02-18T03:23:20.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:20 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3280573088' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:20.900 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:20 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1011441596' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:20 trial119 ceph-mon[24143]: pgmap v272: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 60 MiB/s wr, 5.83k op/s 2026-02-18T03:23:20.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:20 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3280573088' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:20.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:20 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1011441596' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:20 trial114 ceph-mon[23907]: pgmap v272: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s rd, 60 MiB/s wr, 5.83k op/s 2026-02-18T03:23:20.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:20 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3280573088' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:20.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:20 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1011441596' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:22.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:22 trial097 ceph-mon[21799]: pgmap v273: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.16k op/s 2026-02-18T03:23:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:22 trial119 ceph-mon[24143]: pgmap v273: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.16k op/s 2026-02-18T03:23:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:22 trial114 ceph-mon[23907]: pgmap v273: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.16k op/s 2026-02-18T03:23:23.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:23.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.0M 909.2k 0.0k 10.1M 8.9M 0.0k nvme12n1 2026-02-18T03:23:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.70 936.4k 1.0M 0.0k 9.1M 10.1M 0.0k nvme12n10 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.60 970.0k 1.0M 0.0k 9.5M 10.1M 0.0k nvme12n2 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.40 1.0M 996.0k 0.0k 10.3M 9.7M 0.0k nvme12n3 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 1000.8k 928.0k 0.0k 9.8M 9.1M 0.0k nvme12n4 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 82.40 796.8k 974.0k 0.0k 7.8M 9.5M 0.0k nvme12n5 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.20 1.1M 975.2k 0.0k 10.7M 9.5M 0.0k nvme12n6 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 916.4k 1.0M 0.0k 8.9M 10.1M 0.0k nvme12n7 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 816.0k 1004.8k 0.0k 8.0M 9.8M 0.0k nvme12n8 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 972.0k 961.6k 0.0k 9.5M 9.4M 0.0k nvme12n9 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 990.8k 1016.4k 0.0k 9.7M 9.9M 0.0k nvme4n1 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.90 950.8k 1021.6k 0.0k 9.3M 10.0M 0.0k nvme4n10 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.00 898.8k 945.6k 0.0k 8.8M 9.2M 0.0k nvme4n2 2026-02-18T03:23:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 948.4k 1.0M 0.0k 9.3M 10.1M 0.0k nvme4n3 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 913.6k 947.2k 0.0k 8.9M 9.2M 0.0k nvme4n4 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 961.6k 890.8k 0.0k 9.4M 8.7M 0.0k nvme4n5 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 933.2k 958.4k 0.0k 9.1M 9.4M 0.0k nvme4n6 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.10 887.2k 965.2k 0.0k 8.7M 9.4M 0.0k nvme4n7 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 97.10 1013.6k 1002.0k 0.0k 9.9M 9.8M 0.0k nvme4n8 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 1.0M 983.6k 0.0k 10.3M 9.6M 0.0k nvme4n9 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.90 923.2k 972.8k 0.0k 9.0M 9.5M 0.0k nvme8n1 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 924.4k 949.6k 0.0k 9.0M 9.3M 0.0k nvme8n10 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 926.0k 1009.6k 0.0k 9.0M 9.9M 0.0k nvme8n2 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 1.0M 980.4k 0.0k 10.3M 9.6M 0.0k nvme8n3 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 995.6k 929.6k 0.0k 9.7M 9.1M 0.0k nvme8n4 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 98.80 1010.4k 1.0M 0.0k 9.9M 10.3M 0.0k nvme8n5 2026-02-18T03:23:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.60 1.0M 922.4k 0.0k 10.3M 9.0M 0.0k nvme8n6 2026-02-18T03:23:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1009.6k 1.0M 0.0k 9.9M 10.0M 0.0k nvme8n7 2026-02-18T03:23:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 907.2k 952.4k 0.0k 8.9M 9.3M 0.0k nvme8n8 2026-02-18T03:23:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 959.2k 1.0M 0.0k 9.4M 10.1M 0.0k nvme8n9 2026-02-18T03:23:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:23.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/639793026' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:23.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/639793026' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:23.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/639793026' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:23.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:23.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:23.979 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.0M 914.4k 0.0k 10.2M 8.9M 0.0k nvme12n11 2026-02-18T03:23:23.979 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1022.4k 991.2k 0.0k 10.0M 9.7M 0.0k nvme12n12 2026-02-18T03:23:23.979 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.0M 1014.4k 0.0k 10.2M 9.9M 0.0k nvme12n13 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 99.30 1.0M 1009.6k 0.0k 10.4M 9.9M 0.0k nvme12n14 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 984.0k 1.0M 0.0k 9.6M 10.4M 0.0k nvme12n15 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.90 1.1M 934.8k 0.0k 10.6M 9.1M 0.0k nvme12n16 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.0M 947.2k 0.0k 10.1M 9.2M 0.0k nvme12n17 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 970.8k 940.4k 0.0k 9.5M 9.2M 0.0k nvme12n18 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 938.4k 957.2k 0.0k 9.2M 9.3M 0.0k nvme12n19 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 828.8k 1.0M 0.0k 8.1M 10.1M 0.0k nvme12n20 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.00 998.0k 946.8k 0.0k 9.7M 9.2M 0.0k nvme4n11 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 963.6k 954.0k 0.0k 9.4M 9.3M 0.0k nvme4n12 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 980.4k 962.8k 0.0k 9.6M 9.4M 0.0k nvme4n13 2026-02-18T03:23:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 978.8k 1002.0k 0.0k 9.6M 9.8M 0.0k nvme4n14 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 956.8k 944.0k 0.0k 9.3M 9.2M 0.0k nvme4n15 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 910.4k 1022.4k 0.0k 8.9M 10.0M 0.0k nvme4n16 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 978.4k 993.2k 0.0k 9.6M 9.7M 0.0k nvme4n17 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.20 976.0k 1007.2k 0.0k 9.5M 9.8M 0.0k nvme4n18 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 983.2k 1.0M 0.0k 9.6M 10.1M 0.0k nvme4n19 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 1.0M 980.0k 0.0k 10.2M 9.6M 0.0k nvme4n20 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 101.40 1.1M 1.1M 0.0k 10.9M 10.6M 0.0k nvme8n11 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.50 997.2k 993.2k 0.0k 9.7M 9.7M 0.0k nvme8n12 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1.0M 1010.8k 0.0k 10.0M 9.9M 0.0k nvme8n13 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 997.2k 896.4k 0.0k 9.7M 8.8M 0.0k nvme8n14 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 932.0k 976.4k 0.0k 9.1M 9.5M 0.0k nvme8n15 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.60 1.0M 933.6k 0.0k 10.4M 9.1M 0.0k nvme8n16 2026-02-18T03:23:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.90 1.0M 1.0M 0.0k 10.2M 10.2M 0.0k nvme8n17 2026-02-18T03:23:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.00 1.1M 992.0k 0.0k 10.8M 9.7M 0.0k nvme8n18 2026-02-18T03:23:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 982.4k 978.4k 0.0k 9.6M 9.6M 0.0k nvme8n19 2026-02-18T03:23:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 969.6k 1017.2k 0.0k 9.5M 9.9M 0.0k nvme8n20 2026-02-18T03:23:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:24.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:24 trial097 ceph-mon[21799]: pgmap v274: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.99k op/s 2026-02-18T03:23:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:24 trial119 ceph-mon[24143]: pgmap v274: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.99k op/s 2026-02-18T03:23:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:24 trial114 ceph-mon[23907]: pgmap v274: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 5.99k op/s 2026-02-18T03:23:26.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:26 trial097 ceph-mon[21799]: pgmap v275: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 5.18k op/s 2026-02-18T03:23:26.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:26 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1664175523' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:26 trial119 ceph-mon[24143]: pgmap v275: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 5.18k op/s 2026-02-18T03:23:26.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:26 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1664175523' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:26 trial114 ceph-mon[23907]: pgmap v275: 33 pgs: 33 active+clean; 59 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 5.18k op/s 2026-02-18T03:23:26.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:26 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1664175523' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:27.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:27 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3766520843' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:27.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:27 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3893637992' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:27.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:27 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3766520843' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:27.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:27 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3893637992' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:27.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:27 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3766520843' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:27.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:27 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3893637992' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:28.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:28 trial097 ceph-mon[21799]: pgmap v276: 33 pgs: 33 active+clean; 59 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.85k op/s 2026-02-18T03:23:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:28 trial119 ceph-mon[24143]: pgmap v276: 33 pgs: 33 active+clean; 59 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.85k op/s 2026-02-18T03:23:28.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:28 trial114 ceph-mon[23907]: pgmap v276: 33 pgs: 33 active+clean; 59 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.85k op/s 2026-02-18T03:23:30.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:30 trial097 ceph-mon[21799]: pgmap v277: 33 pgs: 33 active+clean; 59 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.86k op/s 2026-02-18T03:23:30.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2847387538' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:30 trial119 ceph-mon[24143]: pgmap v277: 33 pgs: 33 active+clean; 59 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.86k op/s 2026-02-18T03:23:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2847387538' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:30 trial114 ceph-mon[23907]: pgmap v277: 33 pgs: 33 active+clean; 59 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.86k op/s 2026-02-18T03:23:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2847387538' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:32.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:32 trial097 ceph-mon[21799]: pgmap v278: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 5.21k op/s 2026-02-18T03:23:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:32 trial119 ceph-mon[24143]: pgmap v278: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 5.21k op/s 2026-02-18T03:23:32.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:32 trial114 ceph-mon[23907]: pgmap v278: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 5.21k op/s 2026-02-18T03:23:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:33.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 959.2k 958.8k 0.0k 9.4M 9.4M 0.0k nvme12n1 2026-02-18T03:23:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 951.6k 1.0M 0.0k 9.3M 10.4M 0.0k nvme12n10 2026-02-18T03:23:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 1.1M 1.0M 0.0k 10.6M 10.2M 0.0k nvme12n2 2026-02-18T03:23:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 966.0k 958.8k 0.0k 9.4M 9.4M 0.0k nvme12n3 2026-02-18T03:23:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 971.2k 896.4k 0.0k 9.5M 8.8M 0.0k nvme12n4 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 1003.6k 950.4k 0.0k 9.8M 9.3M 0.0k nvme12n5 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 976.0k 966.8k 0.0k 9.5M 9.4M 0.0k nvme12n6 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 101.70 1.0M 1.0M 0.0k 10.4M 10.2M 0.0k nvme12n7 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 978.4k 1.0M 0.0k 9.6M 10.0M 0.0k nvme12n8 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 84.10 842.8k 974.4k 0.0k 8.2M 9.5M 0.0k nvme12n9 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1008.0k 999.6k 0.0k 9.8M 9.8M 0.0k nvme4n1 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.0M 901.2k 0.0k 10.3M 8.8M 0.0k nvme4n10 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 973.2k 950.8k 0.0k 9.5M 9.3M 0.0k nvme4n2 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.90 912.4k 1006.0k 0.0k 8.9M 9.8M 0.0k nvme4n3 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 973.2k 974.8k 0.0k 9.5M 9.5M 0.0k nvme4n4 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 960.4k 945.2k 0.0k 9.4M 9.2M 0.0k nvme4n5 2026-02-18T03:23:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 936.4k 1.1M 0.0k 9.1M 10.6M 0.0k nvme4n6 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 939.6k 974.8k 0.0k 9.2M 9.5M 0.0k nvme4n7 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 899.2k 938.4k 0.0k 8.8M 9.2M 0.0k nvme4n8 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.80 925.2k 973.6k 0.0k 9.0M 9.5M 0.0k nvme4n9 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 1.0M 978.8k 0.0k 10.2M 9.6M 0.0k nvme8n1 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 922.0k 914.4k 0.0k 9.0M 8.9M 0.0k nvme8n10 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 982.8k 988.8k 0.0k 9.6M 9.7M 0.0k nvme8n2 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 99.70 1.0M 1006.4k 0.0k 10.1M 9.8M 0.0k nvme8n3 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 899.6k 948.8k 0.0k 8.8M 9.3M 0.0k nvme8n4 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 966.0k 1017.6k 0.0k 9.4M 9.9M 0.0k nvme8n5 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 976.0k 987.6k 0.0k 9.5M 9.6M 0.0k nvme8n6 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 895.6k 1.1M 0.0k 8.7M 10.5M 0.0k nvme8n7 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.60 1.0M 982.0k 0.0k 10.5M 9.6M 0.0k nvme8n8 2026-02-18T03:23:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 104.70 1.1M 1.0M 0.0k 11.2M 10.1M 0.0k nvme8n9 2026-02-18T03:23:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:33.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:33 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2445589633' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:33.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:33 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2445589633' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:33.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:33 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2445589633' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:33.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:33.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.70 1000.8k 1006.0k 0.0k 9.8M 9.8M 0.0k nvme12n11 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 903.6k 988.4k 0.0k 8.8M 9.7M 0.0k nvme12n12 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.00 987.6k 1004.8k 0.0k 9.6M 9.8M 0.0k nvme12n13 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 1007.2k 978.0k 0.0k 9.8M 9.6M 0.0k nvme12n14 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.90 1.1M 960.0k 0.0k 10.7M 9.4M 0.0k nvme12n15 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.0M 982.4k 0.0k 10.0M 9.6M 0.0k nvme12n16 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.90 958.0k 1.1M 0.0k 9.4M 10.6M 0.0k nvme12n17 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 921.6k 928.0k 0.0k 9.0M 9.1M 0.0k nvme12n18 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 916.0k 1.0M 0.0k 8.9M 10.1M 0.0k nvme12n19 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1008.8k 974.0k 0.0k 9.9M 9.5M 0.0k nvme12n20 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 980.4k 1009.6k 0.0k 9.6M 9.9M 0.0k nvme4n11 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 932.4k 1.1M 0.0k 9.1M 10.7M 0.0k nvme4n12 2026-02-18T03:23:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.40 882.4k 867.6k 0.0k 8.6M 8.5M 0.0k nvme4n13 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 946.4k 979.6k 0.0k 9.2M 9.6M 0.0k nvme4n14 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1023.2k 955.2k 0.0k 10.0M 9.3M 0.0k nvme4n15 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 951.6k 928.4k 0.0k 9.3M 9.1M 0.0k nvme4n16 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 872.8k 1013.2k 0.0k 8.5M 9.9M 0.0k nvme4n17 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.30 1.0M 1023.2k 0.0k 10.4M 10.0M 0.0k nvme4n18 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 970.0k 948.8k 0.0k 9.5M 9.3M 0.0k nvme4n19 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.00 873.6k 937.6k 0.0k 8.5M 9.2M 0.0k nvme4n20 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.20 1.0M 996.0k 0.0k 10.4M 9.7M 0.0k nvme8n11 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 962.0k 1017.2k 0.0k 9.4M 9.9M 0.0k nvme8n12 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1014.0k 953.6k 0.0k 9.9M 9.3M 0.0k nvme8n13 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 947.2k 1012.4k 0.0k 9.2M 9.9M 0.0k nvme8n14 2026-02-18T03:23:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 928.8k 952.4k 0.0k 9.1M 9.3M 0.0k nvme8n15 2026-02-18T03:23:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 977.2k 990.0k 0.0k 9.5M 9.7M 0.0k nvme8n16 2026-02-18T03:23:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 930.0k 1.1M 0.0k 9.1M 10.7M 0.0k nvme8n17 2026-02-18T03:23:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 1.0M 956.0k 0.0k 10.1M 9.3M 0.0k nvme8n18 2026-02-18T03:23:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 949.6k 954.4k 0.0k 9.3M 9.3M 0.0k nvme8n19 2026-02-18T03:23:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.30 900.8k 908.4k 0.0k 8.8M 8.9M 0.0k nvme8n20 2026-02-18T03:23:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:34.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:34 trial097 ceph-mon[21799]: pgmap v279: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 6.02k op/s 2026-02-18T03:23:34.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:34 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1892966198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:34.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:34 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2321671580' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:34 trial119 ceph-mon[24143]: pgmap v279: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 6.02k op/s 2026-02-18T03:23:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:34 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1892966198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:34 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2321671580' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:34 trial114 ceph-mon[23907]: pgmap v279: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s rd, 62 MiB/s wr, 6.02k op/s 2026-02-18T03:23:34.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:34 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1892966198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:34.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:34 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2321671580' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:36.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:36 trial097 ceph-mon[21799]: pgmap v280: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.20k op/s 2026-02-18T03:23:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:36 trial119 ceph-mon[24143]: pgmap v280: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.20k op/s 2026-02-18T03:23:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:36 trial114 ceph-mon[23907]: pgmap v280: 33 pgs: 33 active+clean; 59 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.20k op/s 2026-02-18T03:23:37.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3705615049' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:37.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3705615049' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:37.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3705615049' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:38.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:38 trial097 ceph-mon[21799]: pgmap v281: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 60 MiB/s wr, 5.87k op/s 2026-02-18T03:23:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:38 trial119 ceph-mon[24143]: pgmap v281: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 60 MiB/s wr, 5.87k op/s 2026-02-18T03:23:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:38 trial114 ceph-mon[23907]: pgmap v281: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 60 MiB/s wr, 5.87k op/s 2026-02-18T03:23:40.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:40 trial097 ceph-mon[21799]: pgmap v282: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.84k op/s 2026-02-18T03:23:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:40 trial119 ceph-mon[24143]: pgmap v282: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.84k op/s 2026-02-18T03:23:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:40 trial114 ceph-mon[23907]: pgmap v282: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.84k op/s 2026-02-18T03:23:41.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1824728243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:41.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/848750318' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:41.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3521730473' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:41.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1824728243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:41.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/848750318' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:41.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3521730473' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:41.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1824728243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:41.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/848750318' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:41.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3521730473' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:42.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:42 trial097 ceph-mon[21799]: pgmap v283: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 5.17k op/s 2026-02-18T03:23:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:42 trial119 ceph-mon[24143]: pgmap v283: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 5.17k op/s 2026-02-18T03:23:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:42 trial114 ceph-mon[23907]: pgmap v283: 33 pgs: 33 active+clean; 59 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 5.17k op/s 2026-02-18T03:23:43.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:43.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 926.8k 912.8k 0.0k 9.1M 8.9M 0.0k nvme12n1 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1022.8k 1002.4k 0.0k 10.0M 9.8M 0.0k nvme12n10 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 969.2k 938.0k 0.0k 9.5M 9.2M 0.0k nvme12n2 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.50 902.4k 943.6k 0.0k 8.8M 9.2M 0.0k nvme12n3 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 993.6k 981.2k 0.0k 9.7M 9.6M 0.0k nvme12n4 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 977.2k 926.8k 0.0k 9.5M 9.1M 0.0k nvme12n5 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 863.6k 961.2k 0.0k 8.4M 9.4M 0.0k nvme12n6 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 925.2k 1.1M 0.0k 9.0M 10.9M 0.0k nvme12n7 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 860.0k 966.8k 0.0k 8.4M 9.4M 0.0k nvme12n8 2026-02-18T03:23:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 868.8k 922.4k 0.0k 8.5M 9.0M 0.0k nvme12n9 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 98.80 1.0M 1009.2k 0.0k 10.1M 9.9M 0.0k nvme4n1 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 906.8k 961.6k 0.0k 8.9M 9.4M 0.0k nvme4n10 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 877.6k 1015.2k 0.0k 8.6M 9.9M 0.0k nvme4n2 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 916.8k 947.6k 0.0k 9.0M 9.3M 0.0k nvme4n3 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.50 858.4k 886.4k 0.0k 8.4M 8.7M 0.0k nvme4n4 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 100.40 1010.0k 1009.6k 0.0k 9.9M 9.9M 0.0k nvme4n5 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.40 892.4k 856.4k 0.0k 8.7M 8.4M 0.0k nvme4n6 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 891.6k 910.8k 0.0k 8.7M 8.9M 0.0k nvme4n7 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 991.2k 936.0k 0.0k 9.7M 9.1M 0.0k nvme4n8 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.10 1010.0k 1000.8k 0.0k 9.9M 9.8M 0.0k nvme4n9 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.80 1.0M 986.8k 0.0k 10.1M 9.6M 0.0k nvme8n1 2026-02-18T03:23:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 831.6k 976.0k 0.0k 8.1M 9.5M 0.0k nvme8n10 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.70 932.4k 930.8k 0.0k 9.1M 9.1M 0.0k nvme8n2 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 938.8k 878.8k 0.0k 9.2M 8.6M 0.0k nvme8n3 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.30 1.1M 1005.6k 0.0k 10.6M 9.8M 0.0k nvme8n4 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 863.2k 969.6k 0.0k 8.4M 9.5M 0.0k nvme8n5 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 975.6k 958.0k 0.0k 9.5M 9.4M 0.0k nvme8n6 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 922.8k 964.0k 0.0k 9.0M 9.4M 0.0k nvme8n7 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 1.0M 944.4k 0.0k 10.4M 9.2M 0.0k nvme8n8 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 101.80 1004.4k 965.2k 0.0k 9.8M 9.4M 0.0k nvme8n9 2026-02-18T03:23:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:43.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:43.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 926.4k 907.2k 0.0k 9.0M 8.9M 0.0k nvme12n11 2026-02-18T03:23:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.1M 1011.6k 0.0k 10.6M 9.9M 0.0k nvme12n12 2026-02-18T03:23:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1018.4k 972.0k 0.0k 9.9M 9.5M 0.0k nvme12n13 2026-02-18T03:23:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 902.0k 926.4k 0.0k 8.8M 9.0M 0.0k nvme12n14 2026-02-18T03:23:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 921.2k 991.6k 0.0k 9.0M 9.7M 0.0k nvme12n15 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 809.2k 932.0k 0.0k 7.9M 9.1M 0.0k nvme12n16 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 995.2k 989.2k 0.0k 9.7M 9.7M 0.0k nvme12n17 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 82.50 802.0k 928.4k 0.0k 7.8M 9.1M 0.0k nvme12n18 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 905.6k 944.8k 0.0k 8.8M 9.2M 0.0k nvme12n19 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.00 1.1M 994.0k 0.0k 10.8M 9.7M 0.0k nvme12n20 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 907.2k 939.2k 0.0k 8.9M 9.2M 0.0k nvme4n11 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 100.50 1013.2k 1.0M 0.0k 9.9M 10.3M 0.0k nvme4n12 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 994.4k 1.0M 0.0k 9.7M 10.4M 0.0k nvme4n13 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 1000.4k 1001.2k 0.0k 9.8M 9.8M 0.0k nvme4n14 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 938.0k 960.8k 0.0k 9.2M 9.4M 0.0k nvme4n15 2026-02-18T03:23:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 932.8k 940.4k 0.0k 9.1M 9.2M 0.0k nvme4n16 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.60 892.4k 942.8k 0.0k 8.7M 9.2M 0.0k nvme4n17 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 912.8k 935.6k 0.0k 8.9M 9.1M 0.0k nvme4n18 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 990.8k 936.8k 0.0k 9.7M 9.1M 0.0k nvme4n19 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 1001.6k 849.2k 0.0k 9.8M 8.3M 0.0k nvme4n20 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 828.8k 963.6k 0.0k 8.1M 9.4M 0.0k nvme8n11 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 963.6k 1.0M 0.0k 9.4M 10.2M 0.0k nvme8n12 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 979.2k 926.4k 0.0k 9.6M 9.0M 0.0k nvme8n13 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.00 1.1M 984.0k 0.0k 10.7M 9.6M 0.0k nvme8n14 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 880.4k 925.6k 0.0k 8.6M 9.0M 0.0k nvme8n15 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 972.4k 946.8k 0.0k 9.5M 9.2M 0.0k nvme8n16 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 924.8k 1004.0k 0.0k 9.0M 9.8M 0.0k nvme8n17 2026-02-18T03:23:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 949.2k 879.6k 0.0k 9.3M 8.6M 0.0k nvme8n18 2026-02-18T03:23:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 867.6k 927.6k 0.0k 8.5M 9.1M 0.0k nvme8n19 2026-02-18T03:23:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 939.2k 937.2k 0.0k 9.2M 9.2M 0.0k nvme8n20 2026-02-18T03:23:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:44.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:44 trial097 ceph-mon[21799]: pgmap v284: 33 pgs: 33 active+clean; 59 GiB data, 74 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.99k op/s 2026-02-18T03:23:44.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2578121528' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:44 trial119 ceph-mon[24143]: pgmap v284: 33 pgs: 33 active+clean; 59 GiB data, 74 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.99k op/s 2026-02-18T03:23:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2578121528' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:44 trial114 ceph-mon[23907]: pgmap v284: 33 pgs: 33 active+clean; 59 GiB data, 74 GiB used, 2.7 TiB / 2.7 TiB avail; 57 MiB/s rd, 61 MiB/s wr, 5.99k op/s 2026-02-18T03:23:44.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2578121528' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:46.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:46 trial097 ceph-mon[21799]: pgmap v285: 33 pgs: 33 active+clean; 59 GiB data, 74 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 53 MiB/s wr, 5.17k op/s 2026-02-18T03:23:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:46 trial119 ceph-mon[24143]: pgmap v285: 33 pgs: 33 active+clean; 59 GiB data, 74 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 53 MiB/s wr, 5.17k op/s 2026-02-18T03:23:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:46 trial114 ceph-mon[23907]: pgmap v285: 33 pgs: 33 active+clean; 59 GiB data, 74 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 53 MiB/s wr, 5.17k op/s 2026-02-18T03:23:48.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:48 trial097 ceph-mon[21799]: pgmap v286: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.81k op/s 2026-02-18T03:23:48.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4184618578' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:48.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1590426693' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:48.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2529828511' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:48 trial119 ceph-mon[24143]: pgmap v286: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.81k op/s 2026-02-18T03:23:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4184618578' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:48.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1590426693' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:48.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2529828511' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:48 trial114 ceph-mon[23907]: pgmap v286: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 59 MiB/s wr, 5.81k op/s 2026-02-18T03:23:48.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4184618578' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:48.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1590426693' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:48.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2529828511' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:50.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:50 trial097 ceph-mon[21799]: pgmap v287: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.77k op/s 2026-02-18T03:23:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:50 trial119 ceph-mon[24143]: pgmap v287: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.77k op/s 2026-02-18T03:23:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:50 trial114 ceph-mon[23907]: pgmap v287: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.77k op/s 2026-02-18T03:23:51.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:51 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3206405037' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:51.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:51 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3206405037' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:51.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:51 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3206405037' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:52.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:52 trial097 ceph-mon[21799]: pgmap v288: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 5.12k op/s 2026-02-18T03:23:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:52 trial119 ceph-mon[24143]: pgmap v288: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 5.12k op/s 2026-02-18T03:23:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:52 trial114 ceph-mon[23907]: pgmap v288: 33 pgs: 33 active+clean; 59 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 5.12k op/s 2026-02-18T03:23:53.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1021.4k 980.2k 0.0k 10.0M 9.6M 0.0k nvme12n1 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.61 1.1M 949.5k 0.0k 10.6M 9.3M 0.0k nvme12n10 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.61 969.0k 1.0M 0.0k 9.5M 10.2M 0.0k nvme12n2 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.01 898.7k 895.5k 0.0k 8.8M 8.8M 0.0k nvme12n3 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.01 881.9k 905.9k 0.0k 8.6M 8.9M 0.0k nvme12n4 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.51 935.1k 954.6k 0.0k 9.1M 9.3M 0.0k nvme12n5 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.31 814.0k 866.7k 0.0k 8.0M 8.5M 0.0k nvme12n6 2026-02-18T03:23:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 103.30 1.0M 1.0M 0.0k 10.4M 10.3M 0.0k nvme12n7 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.21 904.7k 944.7k 0.0k 8.8M 9.2M 0.0k nvme12n8 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.71 990.6k 961.8k 0.0k 9.7M 9.4M 0.0k nvme12n9 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.01 852.3k 945.5k 0.0k 8.3M 9.2M 0.0k nvme4n1 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.51 903.1k 969.0k 0.0k 8.8M 9.5M 0.0k nvme4n10 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.01 913.1k 955.8k 0.0k 8.9M 9.3M 0.0k nvme4n2 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.81 967.8k 886.3k 0.0k 9.5M 8.7M 0.0k nvme4n3 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 1.1M 961.0k 0.0k 10.5M 9.4M 0.0k nvme4n4 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.61 907.5k 880.3k 0.0k 8.9M 8.6M 0.0k nvme4n5 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.91 866.7k 929.9k 0.0k 8.5M 9.1M 0.0k nvme4n6 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.81 902.3k 937.5k 0.0k 8.8M 9.2M 0.0k nvme4n7 2026-02-18T03:23:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.61 852.3k 928.7k 0.0k 8.3M 9.1M 0.0k nvme4n8 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.81 916.3k 846.8k 0.0k 9.0M 8.3M 0.0k nvme4n9 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.41 800.4k 898.7k 0.0k 7.8M 8.8M 0.0k nvme8n1 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.81 924.3k 989.0k 0.0k 9.0M 9.7M 0.0k nvme8n10 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.31 860.7k 887.5k 0.0k 8.4M 8.7M 0.0k nvme8n2 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.31 943.9k 943.1k 0.0k 9.2M 9.2M 0.0k nvme8n3 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.41 921.1k 878.3k 0.0k 9.0M 8.6M 0.0k nvme8n4 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.81 906.3k 926.3k 0.0k 8.9M 9.1M 0.0k nvme8n5 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.41 831.6k 888.3k 0.0k 8.1M 8.7M 0.0k nvme8n6 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.61 871.9k 931.9k 0.0k 8.5M 9.1M 0.0k nvme8n7 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.61 954.2k 934.7k 0.0k 9.3M 9.1M 0.0k nvme8n8 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 98.90 989.0k 972.6k 0.0k 9.7M 9.5M 0.0k nvme8n9 2026-02-18T03:23:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:23:53.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:53.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:23:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 999.6k 948.0k 0.0k 9.8M 9.3M 0.0k nvme12n11 2026-02-18T03:23:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 947.2k 902.4k 0.0k 9.2M 8.8M 0.0k nvme12n12 2026-02-18T03:23:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 854.0k 989.2k 0.0k 8.3M 9.7M 0.0k nvme12n13 2026-02-18T03:23:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 872.8k 1008.4k 0.0k 8.5M 9.8M 0.0k nvme12n14 2026-02-18T03:23:53.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.70 908.8k 1007.6k 0.0k 8.9M 9.8M 0.0k nvme12n15 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 878.8k 932.8k 0.0k 8.6M 9.1M 0.0k nvme12n16 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 897.6k 1.0M 0.0k 8.8M 10.1M 0.0k nvme12n17 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 928.4k 964.8k 0.0k 9.1M 9.4M 0.0k nvme12n18 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 946.4k 916.4k 0.0k 9.2M 8.9M 0.0k nvme12n19 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 876.0k 1020.8k 0.0k 8.6M 10.0M 0.0k nvme12n20 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 964.4k 1.0M 0.0k 9.4M 10.2M 0.0k nvme4n11 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 898.0k 917.6k 0.0k 8.8M 9.0M 0.0k nvme4n12 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.10 822.4k 874.4k 0.0k 8.0M 8.5M 0.0k nvme4n13 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 1.0M 934.0k 0.0k 10.3M 9.1M 0.0k nvme4n14 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 100.10 998.4k 938.0k 0.0k 9.8M 9.2M 0.0k nvme4n15 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 917.2k 922.4k 0.0k 9.0M 9.0M 0.0k nvme4n16 2026-02-18T03:23:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 886.8k 873.6k 0.0k 8.7M 8.5M 0.0k nvme4n17 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 919.6k 998.0k 0.0k 9.0M 9.7M 0.0k nvme4n18 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 945.6k 990.0k 0.0k 9.2M 9.7M 0.0k nvme4n19 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 908.4k 994.4k 0.0k 8.9M 9.7M 0.0k nvme4n20 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 919.6k 904.0k 0.0k 9.0M 8.8M 0.0k nvme8n11 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 98.40 1001.2k 1.0M 0.0k 9.8M 10.3M 0.0k nvme8n12 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.10 837.2k 820.8k 0.0k 8.2M 8.0M 0.0k nvme8n13 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 886.8k 916.0k 0.0k 8.7M 8.9M 0.0k nvme8n14 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 890.0k 930.4k 0.0k 8.7M 9.1M 0.0k nvme8n15 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.80 885.6k 964.4k 0.0k 8.6M 9.4M 0.0k nvme8n16 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 960.0k 1010.8k 0.0k 9.4M 9.9M 0.0k nvme8n17 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 996.0k 924.0k 0.0k 9.7M 9.0M 0.0k nvme8n18 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 1016.8k 1013.2k 0.0k 9.9M 9.9M 0.0k nvme8n19 2026-02-18T03:23:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 864.4k 1001.6k 0.0k 8.4M 9.8M 0.0k nvme8n20 2026-02-18T03:23:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:23:54.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:54 trial097 ceph-mon[21799]: pgmap v289: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.93k op/s 2026-02-18T03:23:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:54 trial119 ceph-mon[24143]: pgmap v289: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.93k op/s 2026-02-18T03:23:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:54 trial114 ceph-mon[23907]: pgmap v289: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.93k op/s 2026-02-18T03:23:55.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/591444747' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:55.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/377607463' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:55.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/276107352' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/591444747' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/377607463' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:55.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/276107352' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:55.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/591444747' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/377607463' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/276107352' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:56.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:56 trial097 ceph-mon[21799]: pgmap v290: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 51 MiB/s wr, 5.12k op/s 2026-02-18T03:23:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:56 trial119 ceph-mon[24143]: pgmap v290: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 51 MiB/s wr, 5.12k op/s 2026-02-18T03:23:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:56 trial114 ceph-mon[23907]: pgmap v290: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 51 MiB/s wr, 5.12k op/s 2026-02-18T03:23:58.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:58 trial097 ceph-mon[21799]: pgmap v291: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.81k op/s 2026-02-18T03:23:58.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:23:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/380617894' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:58 trial119 ceph-mon[24143]: pgmap v291: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.81k op/s 2026-02-18T03:23:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:23:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/380617894' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:23:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:58 trial114 ceph-mon[23907]: pgmap v291: 33 pgs: 33 active+clean; 59 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.81k op/s 2026-02-18T03:23:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:23:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/380617894' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:00.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:00 trial097 ceph-mon[21799]: pgmap v292: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.80k op/s 2026-02-18T03:24:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:00 trial119 ceph-mon[24143]: pgmap v292: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.80k op/s 2026-02-18T03:24:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:00 trial114 ceph-mon[23907]: pgmap v292: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 58 MiB/s wr, 5.80k op/s 2026-02-18T03:24:01.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:24:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:01 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:24:01.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:24:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:01 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:24:02.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:02.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:02.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:02.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:24:02.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:01 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:24:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:02 trial119 ceph-mon[24143]: pgmap v293: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 5.18k op/s 2026-02-18T03:24:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1534750379' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/745341703' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2328955695' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:02 trial114 ceph-mon[23907]: pgmap v293: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 5.18k op/s 2026-02-18T03:24:02.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1534750379' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/745341703' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2328955695' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:03.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:02 trial097 ceph-mon[21799]: pgmap v293: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 5.18k op/s 2026-02-18T03:24:03.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1534750379' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:03.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/745341703' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:03.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2328955695' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:03.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:03.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 938.4k 954.0k 0.0k 9.2M 9.3M 0.0k nvme12n1 2026-02-18T03:24:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 85.80 825.2k 993.6k 0.0k 8.1M 9.7M 0.0k nvme12n10 2026-02-18T03:24:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 98.50 1.0M 1023.6k 0.0k 10.1M 10.0M 0.0k nvme12n2 2026-02-18T03:24:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 856.8k 1010.0k 0.0k 8.4M 9.9M 0.0k nvme12n3 2026-02-18T03:24:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 888.8k 943.6k 0.0k 8.7M 9.2M 0.0k nvme12n4 2026-02-18T03:24:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 860.4k 958.8k 0.0k 8.4M 9.4M 0.0k nvme12n5 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 98.00 1.0M 900.0k 0.0k 10.2M 8.8M 0.0k nvme12n6 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 922.0k 891.2k 0.0k 9.0M 8.7M 0.0k nvme12n7 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 892.4k 998.4k 0.0k 8.7M 9.8M 0.0k nvme12n8 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.20 949.6k 895.6k 0.0k 9.3M 8.7M 0.0k nvme12n9 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 898.4k 916.0k 0.0k 8.8M 8.9M 0.0k nvme4n1 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 962.4k 886.0k 0.0k 9.4M 8.7M 0.0k nvme4n10 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 911.2k 935.2k 0.0k 8.9M 9.1M 0.0k nvme4n2 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 915.2k 960.8k 0.0k 8.9M 9.4M 0.0k nvme4n3 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 918.0k 896.4k 0.0k 9.0M 8.8M 0.0k nvme4n4 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 916.4k 956.4k 0.0k 8.9M 9.3M 0.0k nvme4n5 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 887.2k 903.2k 0.0k 8.7M 8.8M 0.0k nvme4n6 2026-02-18T03:24:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 963.6k 950.0k 0.0k 9.4M 9.3M 0.0k nvme4n7 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 892.0k 932.4k 0.0k 8.7M 9.1M 0.0k nvme4n8 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 930.8k 958.0k 0.0k 9.1M 9.4M 0.0k nvme4n9 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 892.8k 891.2k 0.0k 8.7M 8.7M 0.0k nvme8n1 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.20 1.1M 942.0k 0.0k 10.6M 9.2M 0.0k nvme8n10 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 860.8k 984.8k 0.0k 8.4M 9.6M 0.0k nvme8n2 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 858.4k 843.2k 0.0k 8.4M 8.2M 0.0k nvme8n3 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 957.6k 927.6k 0.0k 9.4M 9.1M 0.0k nvme8n4 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 992.8k 920.8k 0.0k 9.7M 9.0M 0.0k nvme8n5 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 867.2k 844.4k 0.0k 8.5M 8.2M 0.0k nvme8n6 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.70 854.0k 960.4k 0.0k 8.3M 9.4M 0.0k nvme8n7 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 1021.2k 884.0k 0.0k 10.0M 8.6M 0.0k nvme8n8 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 99.20 974.4k 977.6k 0.0k 9.5M 9.5M 0.0k nvme8n9 2026-02-18T03:24:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:03.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:03.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 978.0k 986.0k 0.0k 9.6M 9.6M 0.0k nvme12n11 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 906.0k 1.0M 0.0k 8.8M 10.0M 0.0k nvme12n12 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 918.0k 1.0M 0.0k 9.0M 10.3M 0.0k nvme12n13 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 966.4k 886.8k 0.0k 9.4M 8.7M 0.0k nvme12n14 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 932.4k 907.6k 0.0k 9.1M 8.9M 0.0k nvme12n15 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 955.6k 850.0k 0.0k 9.3M 8.3M 0.0k nvme12n16 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 940.0k 976.4k 0.0k 9.2M 9.5M 0.0k nvme12n17 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.70 890.4k 945.6k 0.0k 8.7M 9.2M 0.0k nvme12n18 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 942.8k 904.0k 0.0k 9.2M 8.8M 0.0k nvme12n19 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 901.6k 1010.4k 0.0k 8.8M 9.9M 0.0k nvme12n20 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.40 997.6k 968.0k 0.0k 9.7M 9.5M 0.0k nvme4n11 2026-02-18T03:24:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 971.6k 983.2k 0.0k 9.5M 9.6M 0.0k nvme4n12 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 908.0k 938.4k 0.0k 8.9M 9.2M 0.0k nvme4n13 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 103.70 1.1M 994.0k 0.0k 10.6M 9.7M 0.0k nvme4n14 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 953.2k 975.6k 0.0k 9.3M 9.5M 0.0k nvme4n15 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.60 926.8k 941.6k 0.0k 9.1M 9.2M 0.0k nvme4n16 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 936.0k 915.6k 0.0k 9.1M 8.9M 0.0k nvme4n17 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 956.4k 920.0k 0.0k 9.3M 9.0M 0.0k nvme4n18 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 1.0M 905.6k 0.0k 10.4M 8.8M 0.0k nvme4n19 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 82.70 855.2k 879.2k 0.0k 8.4M 8.6M 0.0k nvme4n20 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 102.90 1.0M 1012.4k 0.0k 10.0M 9.9M 0.0k nvme8n11 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.10 975.2k 1014.8k 0.0k 9.5M 9.9M 0.0k nvme8n12 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 985.2k 936.0k 0.0k 9.6M 9.1M 0.0k nvme8n13 2026-02-18T03:24:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 954.8k 896.0k 0.0k 9.3M 8.8M 0.0k nvme8n14 2026-02-18T03:24:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.50 1.0M 945.6k 0.0k 10.4M 9.2M 0.0k nvme8n15 2026-02-18T03:24:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 905.6k 872.8k 0.0k 8.8M 8.5M 0.0k nvme8n16 2026-02-18T03:24:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 975.6k 988.0k 0.0k 9.5M 9.6M 0.0k nvme8n17 2026-02-18T03:24:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 102.20 1.1M 970.8k 0.0k 10.7M 9.5M 0.0k nvme8n18 2026-02-18T03:24:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 1010.4k 853.2k 0.0k 9.9M 8.3M 0.0k nvme8n19 2026-02-18T03:24:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 930.4k 1.0M 0.0k 9.1M 10.1M 0.0k nvme8n20 2026-02-18T03:24:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:04 trial119 ceph-mon[24143]: pgmap v294: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 6.01k op/s 2026-02-18T03:24:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:04 trial114 ceph-mon[23907]: pgmap v294: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 6.01k op/s 2026-02-18T03:24:05.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:04 trial097 ceph-mon[21799]: pgmap v294: 33 pgs: 33 active+clean; 59 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 6.01k op/s 2026-02-18T03:24:05.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:05 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2272888593' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:05.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:05 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2272888593' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:06.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:05 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2272888593' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:06 trial119 ceph-mon[24143]: pgmap v295: 33 pgs: 33 active+clean; 59 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.21k op/s 2026-02-18T03:24:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:06 trial114 ceph-mon[23907]: pgmap v295: 33 pgs: 33 active+clean; 59 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.21k op/s 2026-02-18T03:24:07.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:06 trial097 ceph-mon[21799]: pgmap v295: 33 pgs: 33 active+clean; 59 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.21k op/s 2026-02-18T03:24:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:08 trial119 ceph-mon[24143]: pgmap v296: 33 pgs: 33 active+clean; 59 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 58 MiB/s wr, 5.88k op/s 2026-02-18T03:24:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:08 trial114 ceph-mon[23907]: pgmap v296: 33 pgs: 33 active+clean; 59 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 58 MiB/s wr, 5.88k op/s 2026-02-18T03:24:09.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:08 trial097 ceph-mon[21799]: pgmap v296: 33 pgs: 33 active+clean; 59 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 58 MiB/s wr, 5.88k op/s 2026-02-18T03:24:09.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1534877506' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3512598887' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1574064645' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:09.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1534877506' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3512598887' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1574064645' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:10.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1534877506' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:10.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3512598887' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:10.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1574064645' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:10 trial119 ceph-mon[24143]: pgmap v297: 33 pgs: 33 active+clean; 59 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 57 MiB/s wr, 5.86k op/s 2026-02-18T03:24:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:10 trial114 ceph-mon[23907]: pgmap v297: 33 pgs: 33 active+clean; 59 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 57 MiB/s wr, 5.86k op/s 2026-02-18T03:24:11.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:10 trial097 ceph-mon[21799]: pgmap v297: 33 pgs: 33 active+clean; 59 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 57 MiB/s wr, 5.86k op/s 2026-02-18T03:24:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:12 trial119 ceph-mon[24143]: pgmap v298: 33 pgs: 33 active+clean; 59 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 5.21k op/s 2026-02-18T03:24:12.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1847740579' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:12.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:12 trial114 ceph-mon[23907]: pgmap v298: 33 pgs: 33 active+clean; 59 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 5.21k op/s 2026-02-18T03:24:12.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1847740579' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:13.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:12 trial097 ceph-mon[21799]: pgmap v298: 33 pgs: 33 active+clean; 59 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 5.21k op/s 2026-02-18T03:24:13.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1847740579' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:13.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:13.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 980.8k 939.6k 0.0k 9.6M 9.2M 0.0k nvme12n1 2026-02-18T03:24:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.20 822.0k 937.6k 0.0k 8.0M 9.2M 0.0k nvme12n10 2026-02-18T03:24:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 99.00 1.0M 971.6k 0.0k 10.1M 9.5M 0.0k nvme12n2 2026-02-18T03:24:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 912.4k 1003.6k 0.0k 8.9M 9.8M 0.0k nvme12n3 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 916.0k 936.0k 0.0k 8.9M 9.1M 0.0k nvme12n4 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 891.6k 945.2k 0.0k 8.7M 9.2M 0.0k nvme12n5 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.60 1007.6k 942.4k 0.0k 9.8M 9.2M 0.0k nvme12n6 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.80 907.6k 996.8k 0.0k 8.9M 9.7M 0.0k nvme12n7 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.20 940.8k 907.2k 0.0k 9.2M 8.9M 0.0k nvme12n8 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 970.4k 918.4k 0.0k 9.5M 9.0M 0.0k nvme12n9 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 924.8k 918.0k 0.0k 9.0M 9.0M 0.0k nvme4n1 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.80 865.6k 952.8k 0.0k 8.5M 9.3M 0.0k nvme4n10 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 866.8k 831.2k 0.0k 8.5M 8.1M 0.0k nvme4n2 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 861.6k 921.6k 0.0k 8.4M 9.0M 0.0k nvme4n3 2026-02-18T03:24:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 938.4k 942.4k 0.0k 9.2M 9.2M 0.0k nvme4n4 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 919.2k 939.2k 0.0k 9.0M 9.2M 0.0k nvme4n5 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.50 837.2k 858.0k 0.0k 8.2M 8.4M 0.0k nvme4n6 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 919.2k 912.8k 0.0k 9.0M 8.9M 0.0k nvme4n7 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 954.8k 946.8k 0.0k 9.3M 9.2M 0.0k nvme4n8 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.0M 898.8k 0.0k 10.4M 8.8M 0.0k nvme4n9 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 97.80 918.4k 918.8k 0.0k 9.0M 9.0M 0.0k nvme8n1 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 919.2k 931.2k 0.0k 9.0M 9.1M 0.0k nvme8n10 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.50 928.4k 912.8k 0.0k 9.1M 8.9M 0.0k nvme8n2 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 904.8k 875.2k 0.0k 8.8M 8.5M 0.0k nvme8n3 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.20 797.6k 840.0k 0.0k 7.8M 8.2M 0.0k nvme8n4 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.0M 937.6k 0.0k 10.0M 9.2M 0.0k nvme8n5 2026-02-18T03:24:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 920.4k 962.0k 0.0k 9.0M 9.4M 0.0k nvme8n6 2026-02-18T03:24:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.0M 922.4k 0.0k 10.2M 9.0M 0.0k nvme8n7 2026-02-18T03:24:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1020.8k 921.6k 0.0k 10.0M 9.0M 0.0k nvme8n8 2026-02-18T03:24:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.60 892.8k 942.4k 0.0k 8.7M 9.2M 0.0k nvme8n9 2026-02-18T03:24:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:13.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:13.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:13.979 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 926.8k 894.8k 0.0k 9.1M 8.7M 0.0k nvme12n11 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 925.2k 938.8k 0.0k 9.0M 9.2M 0.0k nvme12n12 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 927.2k 926.4k 0.0k 9.1M 9.0M 0.0k nvme12n13 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 870.8k 937.6k 0.0k 8.5M 9.2M 0.0k nvme12n14 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 895.2k 1.0M 0.0k 8.7M 10.1M 0.0k nvme12n15 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 1006.4k 904.8k 0.0k 9.8M 8.8M 0.0k nvme12n16 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 893.2k 899.6k 0.0k 8.7M 8.8M 0.0k nvme12n17 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.40 1012.8k 1.0M 0.0k 9.9M 10.5M 0.0k nvme12n18 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 955.6k 882.8k 0.0k 9.3M 8.6M 0.0k nvme12n19 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.70 949.2k 987.2k 0.0k 9.3M 9.6M 0.0k nvme12n20 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 868.0k 894.8k 0.0k 8.5M 8.7M 0.0k nvme4n11 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 101.20 938.8k 1012.0k 0.0k 9.2M 9.9M 0.0k nvme4n12 2026-02-18T03:24:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 989.2k 876.0k 0.0k 9.7M 8.6M 0.0k nvme4n13 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 896.8k 964.4k 0.0k 8.8M 9.4M 0.0k nvme4n14 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.00 900.8k 982.8k 0.0k 8.8M 9.6M 0.0k nvme4n15 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 962.0k 917.6k 0.0k 9.4M 9.0M 0.0k nvme4n16 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 874.0k 891.6k 0.0k 8.5M 8.7M 0.0k nvme4n17 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.50 903.6k 893.2k 0.0k 8.8M 8.7M 0.0k nvme4n18 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 980.4k 921.6k 0.0k 9.6M 9.0M 0.0k nvme4n19 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 936.8k 902.8k 0.0k 9.1M 8.8M 0.0k nvme4n20 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 905.6k 887.2k 0.0k 8.8M 8.7M 0.0k nvme8n11 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 101.60 1.1M 937.6k 0.0k 10.8M 9.2M 0.0k nvme8n12 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 81.30 800.4k 808.4k 0.0k 7.8M 7.9M 0.0k nvme8n13 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 894.4k 887.6k 0.0k 8.7M 8.7M 0.0k nvme8n14 2026-02-18T03:24:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.00 973.2k 976.4k 0.0k 9.5M 9.5M 0.0k nvme8n15 2026-02-18T03:24:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 856.8k 900.8k 0.0k 8.4M 8.8M 0.0k nvme8n16 2026-02-18T03:24:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.60 966.0k 936.4k 0.0k 9.4M 9.1M 0.0k nvme8n17 2026-02-18T03:24:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.00 854.4k 867.6k 0.0k 8.3M 8.5M 0.0k nvme8n18 2026-02-18T03:24:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 904.0k 916.8k 0.0k 8.8M 9.0M 0.0k nvme8n19 2026-02-18T03:24:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.90 1017.2k 866.8k 0.0k 9.9M 8.5M 0.0k nvme8n20 2026-02-18T03:24:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:14 trial119 ceph-mon[24143]: pgmap v299: 33 pgs: 33 active+clean; 60 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 59 MiB/s wr, 6.00k op/s 2026-02-18T03:24:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:14 trial114 ceph-mon[23907]: pgmap v299: 33 pgs: 33 active+clean; 60 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 59 MiB/s wr, 6.00k op/s 2026-02-18T03:24:15.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:14 trial097 ceph-mon[21799]: pgmap v299: 33 pgs: 33 active+clean; 60 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s rd, 59 MiB/s wr, 6.00k op/s 2026-02-18T03:24:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:16 trial119 ceph-mon[24143]: pgmap v300: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 5.19k op/s 2026-02-18T03:24:16.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/835650835' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:16.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2424610328' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:16.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/435137212' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:16 trial114 ceph-mon[23907]: pgmap v300: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 5.19k op/s 2026-02-18T03:24:16.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/835650835' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:16.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2424610328' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:16.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/435137212' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:17.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:16 trial097 ceph-mon[21799]: pgmap v300: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 5.19k op/s 2026-02-18T03:24:17.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/835650835' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:17.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2424610328' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:17.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/435137212' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:18 trial119 ceph-mon[24143]: pgmap v301: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.85k op/s 2026-02-18T03:24:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:18 trial114 ceph-mon[23907]: pgmap v301: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.85k op/s 2026-02-18T03:24:19.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:18 trial097 ceph-mon[21799]: pgmap v301: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.85k op/s 2026-02-18T03:24:19.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/758795528' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:19.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/758795528' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:20.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/758795528' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:20 trial119 ceph-mon[24143]: pgmap v302: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.32k op/s 2026-02-18T03:24:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:20 trial114 ceph-mon[23907]: pgmap v302: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.32k op/s 2026-02-18T03:24:21.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:20 trial097 ceph-mon[21799]: pgmap v302: 33 pgs: 33 active+clean; 60 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.32k op/s 2026-02-18T03:24:22.949 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:22 trial097 ceph-mon[21799]: pgmap v303: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s rd, 50 MiB/s wr, 5.17k op/s 2026-02-18T03:24:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:22 trial119 ceph-mon[24143]: pgmap v303: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s rd, 50 MiB/s wr, 5.17k op/s 2026-02-18T03:24:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:22 trial114 ceph-mon[23907]: pgmap v303: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s rd, 50 MiB/s wr, 5.17k op/s 2026-02-18T03:24:23.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:23.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 925.2k 862.4k 0.0k 9.0M 8.4M 0.0k nvme12n1 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 852.8k 916.8k 0.0k 8.3M 9.0M 0.0k nvme12n10 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 897.6k 977.6k 0.0k 8.8M 9.5M 0.0k nvme12n2 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 1012.0k 912.8k 0.0k 9.9M 8.9M 0.0k nvme12n3 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 957.6k 933.2k 0.0k 9.4M 9.1M 0.0k nvme12n4 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.30 871.6k 922.0k 0.0k 8.5M 9.0M 0.0k nvme12n5 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.00 926.0k 973.6k 0.0k 9.0M 9.5M 0.0k nvme12n6 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 868.4k 922.0k 0.0k 8.5M 9.0M 0.0k nvme12n7 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 914.8k 894.8k 0.0k 8.9M 8.7M 0.0k nvme12n8 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 84.30 826.8k 856.8k 0.0k 8.1M 8.4M 0.0k nvme12n9 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 846.4k 896.4k 0.0k 8.3M 8.8M 0.0k nvme4n1 2026-02-18T03:24:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.30 1016.8k 946.0k 0.0k 9.9M 9.2M 0.0k nvme4n10 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 873.2k 976.8k 0.0k 8.5M 9.5M 0.0k nvme4n2 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 854.4k 967.2k 0.0k 8.3M 9.4M 0.0k nvme4n3 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 849.6k 878.0k 0.0k 8.3M 8.6M 0.0k nvme4n4 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 945.2k 1009.6k 0.0k 9.2M 9.9M 0.0k nvme4n5 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 917.2k 921.2k 0.0k 9.0M 9.0M 0.0k nvme4n6 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 831.6k 829.6k 0.0k 8.1M 8.1M 0.0k nvme4n7 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.20 1014.0k 912.4k 0.0k 9.9M 8.9M 0.0k nvme4n8 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 956.8k 894.8k 0.0k 9.3M 8.7M 0.0k nvme4n9 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 944.8k 935.2k 0.0k 9.2M 9.1M 0.0k nvme8n1 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 910.8k 912.4k 0.0k 8.9M 8.9M 0.0k nvme8n10 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 878.4k 944.0k 0.0k 8.6M 9.2M 0.0k nvme8n2 2026-02-18T03:24:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 984.4k 915.6k 0.0k 9.6M 8.9M 0.0k nvme8n3 2026-02-18T03:24:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.30 800.8k 901.6k 0.0k 7.8M 8.8M 0.0k nvme8n4 2026-02-18T03:24:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 854.4k 957.2k 0.0k 8.3M 9.3M 0.0k nvme8n5 2026-02-18T03:24:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 939.6k 846.0k 0.0k 9.2M 8.3M 0.0k nvme8n6 2026-02-18T03:24:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 857.2k 894.4k 0.0k 8.4M 8.7M 0.0k nvme8n7 2026-02-18T03:24:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 890.4k 908.0k 0.0k 8.7M 8.9M 0.0k nvme8n8 2026-02-18T03:24:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 101.10 994.8k 982.0k 0.0k 9.7M 9.6M 0.0k nvme8n9 2026-02-18T03:24:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:23.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1495502082' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:23.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/308477198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:23.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1750553821' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:23.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1495502082' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:23.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/308477198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:23.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1750553821' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:23.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:23.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 973.2k 912.8k 0.0k 9.5M 8.9M 0.0k nvme12n11 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 99.00 1.1M 950.0k 0.0k 10.6M 9.3M 0.0k nvme12n12 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 980.8k 991.6k 0.0k 9.6M 9.7M 0.0k nvme12n13 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 882.0k 977.2k 0.0k 8.6M 9.5M 0.0k nvme12n14 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 983.6k 907.2k 0.0k 9.6M 8.9M 0.0k nvme12n15 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 894.0k 915.6k 0.0k 8.7M 8.9M 0.0k nvme12n16 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 957.6k 923.6k 0.0k 9.4M 9.0M 0.0k nvme12n17 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 854.8k 926.8k 0.0k 8.3M 9.1M 0.0k nvme12n18 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 895.6k 936.4k 0.0k 8.7M 9.1M 0.0k nvme12n19 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 946.0k 903.6k 0.0k 9.2M 8.8M 0.0k nvme12n20 2026-02-18T03:24:23.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 838.8k 966.0k 0.0k 8.2M 9.4M 0.0k nvme4n11 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 864.8k 951.2k 0.0k 8.4M 9.3M 0.0k nvme4n12 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 83.40 800.4k 869.2k 0.0k 7.8M 8.5M 0.0k nvme4n13 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.10 981.6k 891.6k 0.0k 9.6M 8.7M 0.0k nvme4n14 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 896.4k 961.2k 0.0k 8.8M 9.4M 0.0k nvme4n15 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 954.4k 959.2k 0.0k 9.3M 9.4M 0.0k nvme4n16 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 891.2k 888.4k 0.0k 8.7M 8.7M 0.0k nvme4n17 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 98.90 1.0M 885.6k 0.0k 10.2M 8.6M 0.0k nvme4n18 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 836.4k 860.4k 0.0k 8.2M 8.4M 0.0k nvme4n19 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 853.2k 941.2k 0.0k 8.3M 9.2M 0.0k nvme4n20 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 102.30 1006.0k 938.4k 0.0k 9.8M 9.2M 0.0k nvme8n11 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.40 949.6k 956.8k 0.0k 9.3M 9.3M 0.0k nvme8n12 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 874.8k 887.6k 0.0k 8.5M 8.7M 0.0k nvme8n13 2026-02-18T03:24:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 795.6k 938.4k 0.0k 7.8M 9.2M 0.0k nvme8n14 2026-02-18T03:24:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.40 828.0k 908.4k 0.0k 8.1M 8.9M 0.0k nvme8n15 2026-02-18T03:24:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 968.8k 886.0k 0.0k 9.5M 8.7M 0.0k nvme8n16 2026-02-18T03:24:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 907.6k 959.2k 0.0k 8.9M 9.4M 0.0k nvme8n17 2026-02-18T03:24:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 964.8k 980.0k 0.0k 9.4M 9.6M 0.0k nvme8n18 2026-02-18T03:24:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.00 833.6k 883.6k 0.0k 8.1M 8.6M 0.0k nvme8n19 2026-02-18T03:24:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 947.6k 895.2k 0.0k 9.3M 8.7M 0.0k nvme8n20 2026-02-18T03:24:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:24.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1495502082' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:24.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/308477198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:24.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1750553821' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:24 trial119 ceph-mon[24143]: pgmap v304: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.33k op/s 2026-02-18T03:24:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:24 trial114 ceph-mon[23907]: pgmap v304: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.33k op/s 2026-02-18T03:24:25.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:24 trial097 ceph-mon[21799]: pgmap v304: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 5.33k op/s 2026-02-18T03:24:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:26 trial119 ceph-mon[24143]: pgmap v305: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 5.18k op/s 2026-02-18T03:24:26.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:26 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/4214125980' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:26 trial114 ceph-mon[23907]: pgmap v305: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 5.18k op/s 2026-02-18T03:24:26.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:26 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/4214125980' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:27.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:26 trial097 ceph-mon[21799]: pgmap v305: 33 pgs: 33 active+clean; 60 GiB data, 81 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 5.18k op/s 2026-02-18T03:24:27.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:26 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/4214125980' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:28 trial119 ceph-mon[24143]: pgmap v306: 33 pgs: 33 active+clean; 60 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 56 MiB/s wr, 5.85k op/s 2026-02-18T03:24:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:28 trial114 ceph-mon[23907]: pgmap v306: 33 pgs: 33 active+clean; 60 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 56 MiB/s wr, 5.85k op/s 2026-02-18T03:24:29.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:28 trial097 ceph-mon[21799]: pgmap v306: 33 pgs: 33 active+clean; 60 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 56 MiB/s wr, 5.85k op/s 2026-02-18T03:24:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:30 trial119 ceph-mon[24143]: pgmap v307: 33 pgs: 33 active+clean; 60 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 5.35k op/s 2026-02-18T03:24:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1209437239' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/449727338' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3730125872' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:30 trial114 ceph-mon[23907]: pgmap v307: 33 pgs: 33 active+clean; 60 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 5.35k op/s 2026-02-18T03:24:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1209437239' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/449727338' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3730125872' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:31.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:30 trial097 ceph-mon[21799]: pgmap v307: 33 pgs: 33 active+clean; 60 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 5.35k op/s 2026-02-18T03:24:31.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1209437239' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:31.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/449727338' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:31.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3730125872' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:32 trial119 ceph-mon[24143]: pgmap v308: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.73k op/s 2026-02-18T03:24:32.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:32 trial114 ceph-mon[23907]: pgmap v308: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.73k op/s 2026-02-18T03:24:33.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:32 trial097 ceph-mon[21799]: pgmap v308: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 5.73k op/s 2026-02-18T03:24:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:33.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 860.0k 906.4k 0.0k 8.4M 8.9M 0.0k nvme12n1 2026-02-18T03:24:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 946.8k 866.8k 0.0k 9.2M 8.5M 0.0k nvme12n10 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 937.2k 959.6k 0.0k 9.2M 9.4M 0.0k nvme12n2 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 770.4k 936.8k 0.0k 7.5M 9.1M 0.0k nvme12n3 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.30 790.0k 937.2k 0.0k 7.7M 9.2M 0.0k nvme12n4 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 955.2k 896.8k 0.0k 9.3M 8.8M 0.0k nvme12n5 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 935.6k 939.6k 0.0k 9.1M 9.2M 0.0k nvme12n6 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 934.4k 820.8k 0.0k 9.1M 8.0M 0.0k nvme12n7 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 876.0k 858.8k 0.0k 8.6M 8.4M 0.0k nvme12n8 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.00 932.4k 844.0k 0.0k 9.1M 8.2M 0.0k nvme12n9 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 858.0k 960.4k 0.0k 8.4M 9.4M 0.0k nvme4n1 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 850.4k 818.0k 0.0k 8.3M 8.0M 0.0k nvme4n10 2026-02-18T03:24:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.70 800.4k 873.6k 0.0k 7.8M 8.5M 0.0k nvme4n2 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 905.6k 888.4k 0.0k 8.8M 8.7M 0.0k nvme4n3 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 980.4k 867.6k 0.0k 9.6M 8.5M 0.0k nvme4n4 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 917.6k 925.6k 0.0k 9.0M 9.0M 0.0k nvme4n5 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 970.0k 926.4k 0.0k 9.5M 9.0M 0.0k nvme4n6 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 853.6k 920.0k 0.0k 8.3M 9.0M 0.0k nvme4n7 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 940.0k 863.6k 0.0k 9.2M 8.4M 0.0k nvme4n8 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 815.2k 876.4k 0.0k 8.0M 8.6M 0.0k nvme4n9 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.70 926.0k 906.4k 0.0k 9.0M 8.9M 0.0k nvme8n1 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.90 1013.2k 857.6k 0.0k 9.9M 8.4M 0.0k nvme8n10 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.30 1.0M 884.8k 0.0k 10.2M 8.6M 0.0k nvme8n2 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.60 942.4k 882.4k 0.0k 9.2M 8.6M 0.0k nvme8n3 2026-02-18T03:24:33.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.60 940.4k 898.8k 0.0k 9.2M 8.8M 0.0k nvme8n4 2026-02-18T03:24:33.503 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 960.8k 944.4k 0.0k 9.4M 9.2M 0.0k nvme8n5 2026-02-18T03:24:33.503 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 865.6k 892.4k 0.0k 8.5M 8.7M 0.0k nvme8n6 2026-02-18T03:24:33.503 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 929.6k 934.4k 0.0k 9.1M 9.1M 0.0k nvme8n7 2026-02-18T03:24:33.503 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 976.0k 906.8k 0.0k 9.5M 8.9M 0.0k nvme8n8 2026-02-18T03:24:33.503 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 896.8k 991.2k 0.0k 8.8M 9.7M 0.0k nvme8n9 2026-02-18T03:24:33.503 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:33.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:33 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2697916548' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:33.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:33 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2697916548' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:33.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:33.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:33.979 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 888.0k 918.8k 0.0k 8.7M 9.0M 0.0k nvme12n11 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 802.8k 905.2k 0.0k 7.8M 8.8M 0.0k nvme12n12 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 872.4k 940.4k 0.0k 8.5M 9.2M 0.0k nvme12n13 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 99.10 965.6k 901.2k 0.0k 9.4M 8.8M 0.0k nvme12n14 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 883.2k 870.0k 0.0k 8.6M 8.5M 0.0k nvme12n15 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 977.6k 964.4k 0.0k 9.5M 9.4M 0.0k nvme12n16 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 793.2k 916.0k 0.0k 7.7M 8.9M 0.0k nvme12n17 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 894.8k 896.0k 0.0k 8.7M 8.8M 0.0k nvme12n18 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 968.8k 883.6k 0.0k 9.5M 8.6M 0.0k nvme12n19 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 912.8k 895.2k 0.0k 8.9M 8.7M 0.0k nvme12n20 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 908.0k 910.4k 0.0k 8.9M 8.9M 0.0k nvme4n11 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 966.8k 926.4k 0.0k 9.4M 9.0M 0.0k nvme4n12 2026-02-18T03:24:33.980 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 818.0k 868.0k 0.0k 8.0M 8.5M 0.0k nvme4n13 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.90 982.4k 968.0k 0.0k 9.6M 9.5M 0.0k nvme4n14 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 944.4k 945.6k 0.0k 9.2M 9.2M 0.0k nvme4n15 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 903.2k 830.4k 0.0k 8.8M 8.1M 0.0k nvme4n16 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 827.2k 893.2k 0.0k 8.1M 8.7M 0.0k nvme4n17 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.70 962.0k 909.6k 0.0k 9.4M 8.9M 0.0k nvme4n18 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 994.0k 903.6k 0.0k 9.7M 8.8M 0.0k nvme4n19 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 916.0k 904.8k 0.0k 8.9M 8.8M 0.0k nvme4n20 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.70 916.4k 956.0k 0.0k 8.9M 9.3M 0.0k nvme8n11 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 101.10 927.6k 954.4k 0.0k 9.1M 9.3M 0.0k nvme8n12 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 1006.0k 878.0k 0.0k 9.8M 8.6M 0.0k nvme8n13 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 82.60 815.6k 780.8k 0.0k 8.0M 7.6M 0.0k nvme8n14 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 100.60 1.0M 969.2k 0.0k 10.0M 9.5M 0.0k nvme8n15 2026-02-18T03:24:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.40 829.6k 836.0k 0.0k 8.1M 8.2M 0.0k nvme8n16 2026-02-18T03:24:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.60 904.8k 910.8k 0.0k 8.8M 8.9M 0.0k nvme8n17 2026-02-18T03:24:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 897.2k 823.6k 0.0k 8.8M 8.0M 0.0k nvme8n18 2026-02-18T03:24:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 930.4k 910.4k 0.0k 9.1M 8.9M 0.0k nvme8n19 2026-02-18T03:24:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 859.6k 899.2k 0.0k 8.4M 8.8M 0.0k nvme8n20 2026-02-18T03:24:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:34.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:33 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2697916548' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:34 trial119 ceph-mon[24143]: pgmap v309: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 5.37k op/s 2026-02-18T03:24:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:34 trial114 ceph-mon[23907]: pgmap v309: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 5.37k op/s 2026-02-18T03:24:35.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:34 trial097 ceph-mon[21799]: pgmap v309: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 5.37k op/s 2026-02-18T03:24:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:36 trial119 ceph-mon[24143]: pgmap v310: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 56 MiB/s wr, 5.86k op/s 2026-02-18T03:24:36.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:36 trial114 ceph-mon[23907]: pgmap v310: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 56 MiB/s wr, 5.86k op/s 2026-02-18T03:24:37.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:36 trial097 ceph-mon[21799]: pgmap v310: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s rd, 56 MiB/s wr, 5.86k op/s 2026-02-18T03:24:37.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3589596679' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:37.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/645207305' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:37.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2022665857' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:37.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3589596679' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:37.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/645207305' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:37.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2022665857' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:38.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3589596679' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:38.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/645207305' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:38.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2022665857' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:38 trial119 ceph-mon[24143]: pgmap v311: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.21k op/s 2026-02-18T03:24:38.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:38 trial114 ceph-mon[23907]: pgmap v311: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.21k op/s 2026-02-18T03:24:39.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:38 trial097 ceph-mon[21799]: pgmap v311: 33 pgs: 33 active+clean; 60 GiB data, 83 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.21k op/s 2026-02-18T03:24:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:40 trial119 ceph-mon[24143]: pgmap v312: 33 pgs: 33 active+clean; 60 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 5.36k op/s 2026-02-18T03:24:40.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/548324661' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:40 trial114 ceph-mon[23907]: pgmap v312: 33 pgs: 33 active+clean; 60 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 5.36k op/s 2026-02-18T03:24:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/548324661' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:41.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:40 trial097 ceph-mon[21799]: pgmap v312: 33 pgs: 33 active+clean; 60 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 5.36k op/s 2026-02-18T03:24:41.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/548324661' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:42 trial119 ceph-mon[24143]: pgmap v313: 33 pgs: 33 active+clean; 60 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.71k op/s 2026-02-18T03:24:42.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:42 trial114 ceph-mon[23907]: pgmap v313: 33 pgs: 33 active+clean; 60 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.71k op/s 2026-02-18T03:24:43.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:42 trial097 ceph-mon[21799]: pgmap v313: 33 pgs: 33 active+clean; 60 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.71k op/s 2026-02-18T03:24:43.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:43.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 923.6k 936.4k 0.0k 9.0M 9.1M 0.0k nvme12n1 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 875.2k 857.2k 0.0k 8.5M 8.4M 0.0k nvme12n10 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 844.8k 805.6k 0.0k 8.2M 7.9M 0.0k nvme12n2 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 893.6k 847.2k 0.0k 8.7M 8.3M 0.0k nvme12n3 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 928.4k 924.0k 0.0k 9.1M 9.0M 0.0k nvme12n4 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.80 816.4k 790.4k 0.0k 8.0M 7.7M 0.0k nvme12n5 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 102.20 1.0M 863.6k 0.0k 10.1M 8.4M 0.0k nvme12n6 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.20 819.6k 969.2k 0.0k 8.0M 9.5M 0.0k nvme12n7 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 912.8k 862.0k 0.0k 8.9M 8.4M 0.0k nvme12n8 2026-02-18T03:24:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 914.4k 858.4k 0.0k 8.9M 8.4M 0.0k nvme12n9 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 974.4k 934.0k 0.0k 9.5M 9.1M 0.0k nvme4n1 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 901.6k 839.6k 0.0k 8.8M 8.2M 0.0k nvme4n10 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 888.4k 904.4k 0.0k 8.7M 8.8M 0.0k nvme4n2 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.50 891.6k 935.6k 0.0k 8.7M 9.1M 0.0k nvme4n3 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 961.6k 902.8k 0.0k 9.4M 8.8M 0.0k nvme4n4 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.90 959.6k 892.4k 0.0k 9.4M 8.7M 0.0k nvme4n5 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 955.6k 871.6k 0.0k 9.3M 8.5M 0.0k nvme4n6 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 947.6k 901.2k 0.0k 9.3M 8.8M 0.0k nvme4n7 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 903.6k 864.8k 0.0k 8.8M 8.4M 0.0k nvme4n8 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 980.4k 911.2k 0.0k 9.6M 8.9M 0.0k nvme4n9 2026-02-18T03:24:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 886.0k 822.4k 0.0k 8.7M 8.0M 0.0k nvme8n1 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 854.0k 871.6k 0.0k 8.3M 8.5M 0.0k nvme8n10 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 95.80 931.6k 909.2k 0.0k 9.1M 8.9M 0.0k nvme8n2 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 924.0k 930.4k 0.0k 9.0M 9.1M 0.0k nvme8n3 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 85.80 799.6k 913.2k 0.0k 7.8M 8.9M 0.0k nvme8n4 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 97.10 982.0k 868.4k 0.0k 9.6M 8.5M 0.0k nvme8n5 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 90.10 898.8k 877.6k 0.0k 8.8M 8.6M 0.0k nvme8n6 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 872.8k 844.8k 0.0k 8.5M 8.2M 0.0k nvme8n7 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 884.8k 885.2k 0.0k 8.6M 8.6M 0.0k nvme8n8 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 840.0k 897.2k 0.0k 8.2M 8.8M 0.0k nvme8n9 2026-02-18T03:24:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:43.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:43.984 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:43.984 INFO:tasks.workunit.client.1.trial078.stdout: 97.50 976.4k 998.0k 0.0k 9.5M 9.7M 0.0k nvme12n11 2026-02-18T03:24:43.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 871.6k 920.4k 0.0k 8.5M 9.0M 0.0k nvme12n12 2026-02-18T03:24:43.984 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 832.0k 948.8k 0.0k 8.1M 9.3M 0.0k nvme12n13 2026-02-18T03:24:43.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 860.8k 900.8k 0.0k 8.4M 8.8M 0.0k nvme12n14 2026-02-18T03:24:43.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 822.4k 892.8k 0.0k 8.0M 8.7M 0.0k nvme12n15 2026-02-18T03:24:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 98.00 979.2k 889.2k 0.0k 9.6M 8.7M 0.0k nvme12n16 2026-02-18T03:24:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 972.0k 862.0k 0.0k 9.5M 8.4M 0.0k nvme12n17 2026-02-18T03:24:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 929.2k 903.2k 0.0k 9.1M 8.8M 0.0k nvme12n18 2026-02-18T03:24:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 99.70 980.8k 892.0k 0.0k 9.6M 8.7M 0.0k nvme12n19 2026-02-18T03:24:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 96.40 938.8k 860.4k 0.0k 9.2M 8.4M 0.0k nvme12n20 2026-02-18T03:24:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 947.2k 912.4k 0.0k 9.2M 8.9M 0.0k nvme4n11 2026-02-18T03:24:43.985 INFO:tasks.workunit.client.1.trial078.stdout: 101.20 1.0M 859.2k 0.0k 10.0M 8.4M 0.0k nvme4n12 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 790.8k 927.2k 0.0k 7.7M 9.1M 0.0k nvme4n13 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 856.8k 837.6k 0.0k 8.4M 8.2M 0.0k nvme4n14 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 96.10 944.8k 887.2k 0.0k 9.2M 8.7M 0.0k nvme4n15 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 872.4k 813.6k 0.0k 8.5M 7.9M 0.0k nvme4n16 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 863.6k 870.8k 0.0k 8.4M 8.5M 0.0k nvme4n17 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 739.2k 895.2k 0.0k 7.2M 8.7M 0.0k nvme4n18 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 82.80 713.2k 908.8k 0.0k 7.0M 8.9M 0.0k nvme4n19 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 970.0k 870.8k 0.0k 9.5M 8.5M 0.0k nvme4n20 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 99.90 903.2k 954.0k 0.0k 8.8M 9.3M 0.0k nvme8n11 2026-02-18T03:24:43.986 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 870.8k 950.4k 0.0k 8.5M 9.3M 0.0k nvme8n12 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 93.90 956.4k 903.6k 0.0k 9.3M 8.8M 0.0k nvme8n13 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 848.8k 930.0k 0.0k 8.3M 9.1M 0.0k nvme8n14 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 912.4k 810.0k 0.0k 8.9M 7.9M 0.0k nvme8n15 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 858.8k 848.4k 0.0k 8.4M 8.3M 0.0k nvme8n16 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 876.8k 832.0k 0.0k 8.6M 8.1M 0.0k nvme8n17 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 954.4k 915.6k 0.0k 9.3M 8.9M 0.0k nvme8n18 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 838.4k 880.0k 0.0k 8.2M 8.6M 0.0k nvme8n19 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 957.2k 802.0k 0.0k 9.3M 7.8M 0.0k nvme8n20 2026-02-18T03:24:43.987 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:44 trial119 ceph-mon[24143]: pgmap v314: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 5.36k op/s 2026-02-18T03:24:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2852248763' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2581242922' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1770409523' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:44 trial114 ceph-mon[23907]: pgmap v314: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 5.36k op/s 2026-02-18T03:24:44.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2852248763' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:44.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2581242922' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:44.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1770409523' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:45.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:44 trial097 ceph-mon[21799]: pgmap v314: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 5.36k op/s 2026-02-18T03:24:45.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2852248763' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:45.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2581242922' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:45.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1770409523' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:46 trial114 ceph-mon[23907]: pgmap v315: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 55 MiB/s wr, 5.87k op/s 2026-02-18T03:24:47.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:46 trial097 ceph-mon[21799]: pgmap v315: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 55 MiB/s wr, 5.87k op/s 2026-02-18T03:24:47.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:46 trial119 ceph-mon[24143]: pgmap v315: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s rd, 55 MiB/s wr, 5.87k op/s 2026-02-18T03:24:47.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:47 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/4194110303' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:48.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:47 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/4194110303' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:48.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:47 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/4194110303' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:48.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:48 trial114 ceph-mon[23907]: pgmap v316: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.24k op/s 2026-02-18T03:24:49.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:48 trial097 ceph-mon[21799]: pgmap v316: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.24k op/s 2026-02-18T03:24:49.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:48 trial119 ceph-mon[24143]: pgmap v316: 33 pgs: 33 active+clean; 60 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.24k op/s 2026-02-18T03:24:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:50 trial114 ceph-mon[23907]: pgmap v317: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 56 MiB/s wr, 6.05k op/s 2026-02-18T03:24:51.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:50 trial097 ceph-mon[21799]: pgmap v317: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 56 MiB/s wr, 6.05k op/s 2026-02-18T03:24:51.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:50 trial119 ceph-mon[24143]: pgmap v317: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s rd, 56 MiB/s wr, 6.05k op/s 2026-02-18T03:24:52.049 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:51 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/81662560' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:52.050 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:51 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3174719600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:52.050 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:51 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/665349369' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:52.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:51 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/81662560' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:52.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:51 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3174719600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:52.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:51 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/665349369' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:52.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:51 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/81662560' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:52.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:51 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3174719600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:52.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:51 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/665349369' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:53.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:52 trial097 ceph-mon[21799]: pgmap v318: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.71k op/s 2026-02-18T03:24:53.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:52 trial119 ceph-mon[24143]: pgmap v318: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.71k op/s 2026-02-18T03:24:53.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:52 trial114 ceph-mon[23907]: pgmap v318: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.71k op/s 2026-02-18T03:24:53.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:53.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 966.4k 824.0k 0.0k 9.4M 8.0M 0.0k nvme12n1 2026-02-18T03:24:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 906.0k 886.0k 0.0k 8.8M 8.7M 0.0k nvme12n10 2026-02-18T03:24:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 869.2k 910.0k 0.0k 8.5M 8.9M 0.0k nvme12n2 2026-02-18T03:24:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 796.4k 908.8k 0.0k 7.8M 8.9M 0.0k nvme12n3 2026-02-18T03:24:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 917.6k 782.4k 0.0k 9.0M 7.6M 0.0k nvme12n4 2026-02-18T03:24:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 83.70 772.0k 851.6k 0.0k 7.5M 8.3M 0.0k nvme12n5 2026-02-18T03:24:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.90 961.2k 918.0k 0.0k 9.4M 9.0M 0.0k nvme12n6 2026-02-18T03:24:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 807.6k 1000.8k 0.0k 7.9M 9.8M 0.0k nvme12n7 2026-02-18T03:24:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 822.0k 813.2k 0.0k 8.0M 7.9M 0.0k nvme12n8 2026-02-18T03:24:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 761.2k 807.6k 0.0k 7.4M 7.9M 0.0k nvme12n9 2026-02-18T03:24:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.60 983.6k 873.2k 0.0k 9.6M 8.5M 0.0k nvme4n1 2026-02-18T03:24:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 898.0k 777.6k 0.0k 8.8M 7.6M 0.0k nvme4n10 2026-02-18T03:24:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 842.4k 859.2k 0.0k 8.2M 8.4M 0.0k nvme4n2 2026-02-18T03:24:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.40 953.2k 794.0k 0.0k 9.3M 7.8M 0.0k nvme4n3 2026-02-18T03:24:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 841.2k 856.8k 0.0k 8.2M 8.4M 0.0k nvme4n4 2026-02-18T03:24:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 934.0k 819.6k 0.0k 9.1M 8.0M 0.0k nvme4n5 2026-02-18T03:24:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 816.4k 816.0k 0.0k 8.0M 8.0M 0.0k nvme4n6 2026-02-18T03:24:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 870.4k 885.6k 0.0k 8.5M 8.6M 0.0k nvme4n7 2026-02-18T03:24:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 735.6k 876.8k 0.0k 7.2M 8.6M 0.0k nvme4n8 2026-02-18T03:24:53.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 771.2k 964.0k 0.0k 7.5M 9.4M 0.0k nvme4n9 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 842.4k 932.0k 0.0k 8.2M 9.1M 0.0k nvme8n1 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 767.6k 895.2k 0.0k 7.5M 8.7M 0.0k nvme8n10 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 98.40 903.6k 919.2k 0.0k 8.8M 9.0M 0.0k nvme8n2 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 921.6k 892.4k 0.0k 9.0M 8.7M 0.0k nvme8n3 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 100.00 994.8k 926.4k 0.0k 9.7M 9.0M 0.0k nvme8n4 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 870.4k 819.2k 0.0k 8.5M 8.0M 0.0k nvme8n5 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 793.6k 899.6k 0.0k 7.8M 8.8M 0.0k nvme8n6 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 842.0k 818.4k 0.0k 8.2M 8.0M 0.0k nvme8n7 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 898.0k 836.0k 0.0k 8.8M 8.2M 0.0k nvme8n8 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 100.60 964.8k 902.0k 0.0k 9.4M 8.8M 0.0k nvme8n9 2026-02-18T03:24:53.503 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:24:53.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:53.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:24:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 940.0k 816.4k 0.0k 9.2M 8.0M 0.0k nvme12n11 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 914.4k 846.4k 0.0k 8.9M 8.3M 0.0k nvme12n12 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 99.60 993.6k 932.8k 0.0k 9.7M 9.1M 0.0k nvme12n13 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 974.0k 931.2k 0.0k 9.5M 9.1M 0.0k nvme12n14 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 924.0k 826.4k 0.0k 9.0M 8.1M 0.0k nvme12n15 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.60 922.4k 854.0k 0.0k 9.0M 8.3M 0.0k nvme12n16 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 800.0k 906.0k 0.0k 7.8M 8.8M 0.0k nvme12n17 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 875.6k 828.4k 0.0k 8.6M 8.1M 0.0k nvme12n18 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 787.2k 841.2k 0.0k 7.7M 8.2M 0.0k nvme12n19 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 832.4k 972.0k 0.0k 8.1M 9.5M 0.0k nvme12n20 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 920.8k 824.8k 0.0k 9.0M 8.1M 0.0k nvme4n11 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 908.4k 887.2k 0.0k 8.9M 8.7M 0.0k nvme4n12 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 843.6k 828.0k 0.0k 8.2M 8.1M 0.0k nvme4n13 2026-02-18T03:24:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 797.6k 928.8k 0.0k 7.8M 9.1M 0.0k nvme4n14 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 99.40 968.0k 889.6k 0.0k 9.5M 8.7M 0.0k nvme4n15 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 870.4k 892.0k 0.0k 8.5M 8.7M 0.0k nvme4n16 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.90 802.8k 802.0k 0.0k 7.8M 7.8M 0.0k nvme4n17 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 863.2k 929.6k 0.0k 8.4M 9.1M 0.0k nvme4n18 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 843.2k 860.0k 0.0k 8.2M 8.4M 0.0k nvme4n19 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 926.4k 869.6k 0.0k 9.0M 8.5M 0.0k nvme4n20 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 99.40 925.6k 935.2k 0.0k 9.0M 9.1M 0.0k nvme8n11 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.50 946.4k 856.4k 0.0k 9.2M 8.4M 0.0k nvme8n12 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 938.8k 898.4k 0.0k 9.2M 8.8M 0.0k nvme8n13 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.40 872.8k 856.8k 0.0k 8.5M 8.4M 0.0k nvme8n14 2026-02-18T03:24:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 828.4k 839.2k 0.0k 8.1M 8.2M 0.0k nvme8n15 2026-02-18T03:24:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 806.0k 905.6k 0.0k 7.9M 8.8M 0.0k nvme8n16 2026-02-18T03:24:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 959.6k 901.6k 0.0k 9.4M 8.8M 0.0k nvme8n17 2026-02-18T03:24:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 907.6k 907.6k 0.0k 8.9M 8.9M 0.0k nvme8n18 2026-02-18T03:24:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 852.0k 896.8k 0.0k 8.3M 8.8M 0.0k nvme8n19 2026-02-18T03:24:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 824.8k 863.2k 0.0k 8.1M 8.4M 0.0k nvme8n20 2026-02-18T03:24:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:24:54.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:53 trial097 ceph-mon[21799]: pgmap v319: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.37k op/s 2026-02-18T03:24:54.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:53 trial119 ceph-mon[24143]: pgmap v319: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.37k op/s 2026-02-18T03:24:54.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:53 trial114 ceph-mon[23907]: pgmap v319: 33 pgs: 33 active+clean; 60 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.37k op/s 2026-02-18T03:24:55.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:54 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3090881225' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:55.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:54 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3090881225' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:55.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:54 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3090881225' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:56.148 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:55 trial097 ceph-mon[21799]: pgmap v320: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 5.85k op/s 2026-02-18T03:24:56.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:55 trial119 ceph-mon[24143]: pgmap v320: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 5.85k op/s 2026-02-18T03:24:56.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:55 trial114 ceph-mon[23907]: pgmap v320: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 5.85k op/s 2026-02-18T03:24:58.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:58 trial097 ceph-mon[21799]: pgmap v321: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 5.19k op/s 2026-02-18T03:24:58.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/598758228' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:58.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/4149998154' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:58.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:24:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2995137822' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:58 trial119 ceph-mon[24143]: pgmap v321: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 5.19k op/s 2026-02-18T03:24:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/598758228' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/4149998154' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:24:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2995137822' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:58 trial114 ceph-mon[23907]: pgmap v321: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 5.19k op/s 2026-02-18T03:24:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/598758228' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/4149998154' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:24:58.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:24:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2995137822' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:00.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:00 trial097 ceph-mon[21799]: pgmap v322: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 55 MiB/s wr, 5.99k op/s 2026-02-18T03:25:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:00 trial119 ceph-mon[24143]: pgmap v322: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 55 MiB/s wr, 5.99k op/s 2026-02-18T03:25:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:00 trial114 ceph-mon[23907]: pgmap v322: 33 pgs: 33 active+clean; 60 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 55 MiB/s wr, 5.99k op/s 2026-02-18T03:25:01.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3348837907' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:01.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:01 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3348837907' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:01.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:01 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3348837907' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:02.875 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:02 trial114 ceph-mon[23907]: pgmap v323: 33 pgs: 33 active+clean; 60 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.67k op/s 2026-02-18T03:25:02.875 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:02.875 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.875 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.875 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.876 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:02.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:02 trial097 ceph-mon[21799]: pgmap v323: 33 pgs: 33 active+clean; 60 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.67k op/s 2026-02-18T03:25:02.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:02.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:02.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:02.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:02 trial119 ceph-mon[24143]: pgmap v323: 33 pgs: 33 active+clean; 60 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.67k op/s 2026-02-18T03:25:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:25:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:03.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:03.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 887.6k 866.0k 0.0k 8.7M 8.5M 0.0k nvme12n1 2026-02-18T03:25:03.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 809.6k 886.4k 0.0k 7.9M 8.7M 0.0k nvme12n10 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.60 864.0k 885.6k 0.0k 8.4M 8.6M 0.0k nvme12n2 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 913.2k 873.6k 0.0k 8.9M 8.5M 0.0k nvme12n3 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.80 770.8k 920.8k 0.0k 7.5M 9.0M 0.0k nvme12n4 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 82.90 844.0k 780.0k 0.0k 8.2M 7.6M 0.0k nvme12n5 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.20 910.4k 900.0k 0.0k 8.9M 8.8M 0.0k nvme12n6 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 806.0k 931.6k 0.0k 7.9M 9.1M 0.0k nvme12n7 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 870.8k 756.8k 0.0k 8.5M 7.4M 0.0k nvme12n8 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.50 786.8k 781.2k 0.0k 7.7M 7.6M 0.0k nvme12n9 2026-02-18T03:25:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 840.0k 828.0k 0.0k 8.2M 8.1M 0.0k nvme4n1 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 804.4k 876.8k 0.0k 7.9M 8.6M 0.0k nvme4n10 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.50 1023.6k 841.6k 0.0k 10.0M 8.2M 0.0k nvme4n2 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 99.60 932.0k 947.2k 0.0k 9.1M 9.2M 0.0k nvme4n3 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 821.6k 977.6k 0.0k 8.0M 9.5M 0.0k nvme4n4 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 97.10 887.2k 892.8k 0.0k 8.7M 8.7M 0.0k nvme4n5 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 869.6k 779.6k 0.0k 8.5M 7.6M 0.0k nvme4n6 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 790.4k 856.0k 0.0k 7.7M 8.4M 0.0k nvme4n7 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 824.4k 884.8k 0.0k 8.1M 8.6M 0.0k nvme4n8 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 834.0k 816.4k 0.0k 8.1M 8.0M 0.0k nvme4n9 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.70 869.2k 876.8k 0.0k 8.5M 8.6M 0.0k nvme8n1 2026-02-18T03:25:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.60 908.4k 943.6k 0.0k 8.9M 9.2M 0.0k nvme8n10 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 796.0k 898.8k 0.0k 7.8M 8.8M 0.0k nvme8n2 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 834.4k 886.8k 0.0k 8.1M 8.7M 0.0k nvme8n3 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.90 971.2k 852.4k 0.0k 9.5M 8.3M 0.0k nvme8n4 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 842.8k 887.2k 0.0k 8.2M 8.7M 0.0k nvme8n5 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 831.2k 918.8k 0.0k 8.1M 9.0M 0.0k nvme8n6 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 876.8k 865.6k 0.0k 8.6M 8.5M 0.0k nvme8n7 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 846.8k 896.4k 0.0k 8.3M 8.8M 0.0k nvme8n8 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.00 843.2k 817.6k 0.0k 8.2M 8.0M 0.0k nvme8n9 2026-02-18T03:25:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:03.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:03.983 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 887.6k 819.6k 0.0k 8.7M 8.0M 0.0k nvme12n11 2026-02-18T03:25:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 818.0k 810.8k 0.0k 8.0M 7.9M 0.0k nvme12n12 2026-02-18T03:25:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 742.4k 934.4k 0.0k 7.2M 9.1M 0.0k nvme12n13 2026-02-18T03:25:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 906.8k 875.6k 0.0k 8.9M 8.6M 0.0k nvme12n14 2026-02-18T03:25:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 847.6k 920.8k 0.0k 8.3M 9.0M 0.0k nvme12n15 2026-02-18T03:25:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 868.4k 866.4k 0.0k 8.5M 8.5M 0.0k nvme12n16 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 788.4k 957.6k 0.0k 7.7M 9.4M 0.0k nvme12n17 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 812.8k 790.0k 0.0k 7.9M 7.7M 0.0k nvme12n18 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 855.6k 878.0k 0.0k 8.4M 8.6M 0.0k nvme12n19 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 803.6k 780.0k 0.0k 7.8M 7.6M 0.0k nvme12n20 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 94.60 861.6k 871.6k 0.0k 8.4M 8.5M 0.0k nvme4n11 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 792.4k 813.6k 0.0k 7.7M 7.9M 0.0k nvme4n12 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 800.4k 858.4k 0.0k 7.8M 8.4M 0.0k nvme4n13 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 897.6k 854.4k 0.0k 8.8M 8.3M 0.0k nvme4n14 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 900.8k 844.0k 0.0k 8.8M 8.2M 0.0k nvme4n15 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 834.0k 818.0k 0.0k 8.1M 8.0M 0.0k nvme4n16 2026-02-18T03:25:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 843.6k 820.8k 0.0k 8.2M 8.0M 0.0k nvme4n17 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 888.4k 942.0k 0.0k 8.7M 9.2M 0.0k nvme4n18 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 827.2k 792.0k 0.0k 8.1M 7.7M 0.0k nvme4n19 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 910.4k 777.6k 0.0k 8.9M 7.6M 0.0k nvme4n20 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 101.90 980.0k 910.0k 0.0k 9.6M 8.9M 0.0k nvme8n11 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 845.6k 931.2k 0.0k 8.3M 9.1M 0.0k nvme8n12 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 888.0k 856.0k 0.0k 8.7M 8.4M 0.0k nvme8n13 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 962.0k 835.6k 0.0k 9.4M 8.2M 0.0k nvme8n14 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 855.2k 856.0k 0.0k 8.4M 8.4M 0.0k nvme8n15 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 833.6k 914.8k 0.0k 8.1M 8.9M 0.0k nvme8n16 2026-02-18T03:25:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 882.8k 970.8k 0.0k 8.6M 9.5M 0.0k nvme8n17 2026-02-18T03:25:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 100.00 943.2k 940.4k 0.0k 9.2M 9.2M 0.0k nvme8n18 2026-02-18T03:25:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 860.0k 921.6k 0.0k 8.4M 9.0M 0.0k nvme8n19 2026-02-18T03:25:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 788.4k 905.6k 0.0k 7.7M 8.8M 0.0k nvme8n20 2026-02-18T03:25:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:04.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:04 trial097 ceph-mon[21799]: pgmap v324: 33 pgs: 33 active+clean; 60 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 5.34k op/s 2026-02-18T03:25:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:04 trial119 ceph-mon[24143]: pgmap v324: 33 pgs: 33 active+clean; 60 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 5.34k op/s 2026-02-18T03:25:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:04 trial114 ceph-mon[23907]: pgmap v324: 33 pgs: 33 active+clean; 60 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 5.34k op/s 2026-02-18T03:25:05.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:05 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1884234158' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:05.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:05 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1405240150' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:05.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:05 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1884234158' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:05.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:05 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1405240150' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:05.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:05 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1884234158' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:05.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:05 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1405240150' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:06.713 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:06 trial119 ceph-mon[24143]: pgmap v325: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.80k op/s 2026-02-18T03:25:06.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:06 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/4249710621' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:06.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:06 trial097 ceph-mon[21799]: pgmap v325: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.80k op/s 2026-02-18T03:25:06.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:06 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/4249710621' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:06 trial114 ceph-mon[23907]: pgmap v325: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.80k op/s 2026-02-18T03:25:06.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:06 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/4249710621' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:08.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:08 trial097 ceph-mon[21799]: pgmap v326: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 5.16k op/s 2026-02-18T03:25:08.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:08 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1685348742' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:08 trial119 ceph-mon[24143]: pgmap v326: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 5.16k op/s 2026-02-18T03:25:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:08 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1685348742' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:08 trial114 ceph-mon[23907]: pgmap v326: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 5.16k op/s 2026-02-18T03:25:08.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:08 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1685348742' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:10.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:10 trial097 ceph-mon[21799]: pgmap v327: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.95k op/s 2026-02-18T03:25:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:10 trial119 ceph-mon[24143]: pgmap v327: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.95k op/s 2026-02-18T03:25:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:10 trial114 ceph-mon[23907]: pgmap v327: 33 pgs: 33 active+clean; 60 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.95k op/s 2026-02-18T03:25:12.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:12 trial097 ceph-mon[21799]: pgmap v328: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.67k op/s 2026-02-18T03:25:12.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2997110199' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:12.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1129165185' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:12 trial119 ceph-mon[24143]: pgmap v328: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.67k op/s 2026-02-18T03:25:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2997110199' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1129165185' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:12 trial114 ceph-mon[23907]: pgmap v328: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.67k op/s 2026-02-18T03:25:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2997110199' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1129165185' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:13.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 814.4k 815.6k 0.0k 8.0M 8.0M 0.0k nvme12n1 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 786.0k 760.0k 0.0k 7.7M 7.4M 0.0k nvme12n10 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 870.8k 941.6k 0.0k 8.5M 9.2M 0.0k nvme12n2 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 755.6k 918.4k 0.0k 7.4M 9.0M 0.0k nvme12n3 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 923.6k 836.8k 0.0k 9.0M 8.2M 0.0k nvme12n4 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 793.6k 852.4k 0.0k 7.8M 8.3M 0.0k nvme12n5 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 794.8k 826.0k 0.0k 7.8M 8.1M 0.0k nvme12n6 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 96.90 864.0k 912.4k 0.0k 8.4M 8.9M 0.0k nvme12n7 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 87.70 804.4k 860.0k 0.0k 7.9M 8.4M 0.0k nvme12n8 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 841.2k 843.6k 0.0k 8.2M 8.2M 0.0k nvme12n9 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 853.2k 911.6k 0.0k 8.3M 8.9M 0.0k nvme4n1 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 882.0k 828.0k 0.0k 8.6M 8.1M 0.0k nvme4n10 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 899.2k 862.0k 0.0k 8.8M 8.4M 0.0k nvme4n2 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 846.4k 862.0k 0.0k 8.3M 8.4M 0.0k nvme4n3 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 872.0k 798.0k 0.0k 8.5M 7.8M 0.0k nvme4n4 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 87.70 826.4k 798.0k 0.0k 8.1M 7.8M 0.0k nvme4n5 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 909.2k 882.8k 0.0k 8.9M 8.6M 0.0k nvme4n6 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 93.60 932.4k 849.2k 0.0k 9.1M 8.3M 0.0k nvme4n7 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 837.6k 916.0k 0.0k 8.2M 8.9M 0.0k nvme4n8 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 796.0k 822.0k 0.0k 7.8M 8.0M 0.0k nvme4n9 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 885.6k 898.8k 0.0k 8.6M 8.8M 0.0k nvme8n1 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 882.8k 890.8k 0.0k 8.6M 8.7M 0.0k nvme8n10 2026-02-18T03:25:13.495 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 919.2k 830.4k 0.0k 9.0M 8.1M 0.0k nvme8n2 2026-02-18T03:25:13.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 792.4k 858.4k 0.0k 7.7M 8.4M 0.0k nvme8n3 2026-02-18T03:25:13.496 INFO:tasks.workunit.client.0.trial031.stdout: 88.90 873.2k 818.4k 0.0k 8.5M 8.0M 0.0k nvme8n4 2026-02-18T03:25:13.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 853.6k 812.4k 0.0k 8.3M 7.9M 0.0k nvme8n5 2026-02-18T03:25:13.496 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 816.4k 850.0k 0.0k 8.0M 8.3M 0.0k nvme8n6 2026-02-18T03:25:13.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 844.4k 834.0k 0.0k 8.2M 8.1M 0.0k nvme8n7 2026-02-18T03:25:13.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 920.8k 816.8k 0.0k 9.0M 8.0M 0.0k nvme8n8 2026-02-18T03:25:13.496 INFO:tasks.workunit.client.0.trial031.stdout: 101.30 925.2k 849.2k 0.0k 9.0M 8.3M 0.0k nvme8n9 2026-02-18T03:25:13.496 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:13.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:13 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1691814023' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:13.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:13 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1691814023' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:13.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:13 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1691814023' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:13.974 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 818.4k 857.2k 0.0k 8.0M 8.4M 0.0k nvme12n11 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 836.4k 930.4k 0.0k 8.2M 9.1M 0.0k nvme12n12 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 859.6k 916.4k 0.0k 8.4M 8.9M 0.0k nvme12n13 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 771.2k 847.6k 0.0k 7.5M 8.3M 0.0k nvme12n14 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 924.0k 894.8k 0.0k 9.0M 8.7M 0.0k nvme12n15 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 839.2k 843.2k 0.0k 8.2M 8.2M 0.0k nvme12n16 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.30 828.0k 958.8k 0.0k 8.1M 9.4M 0.0k nvme12n17 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 868.0k 805.2k 0.0k 8.5M 7.9M 0.0k nvme12n18 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 896.0k 815.2k 0.0k 8.8M 8.0M 0.0k nvme12n19 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 99.80 982.8k 843.2k 0.0k 9.6M 8.2M 0.0k nvme12n20 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 920.8k 833.2k 0.0k 9.0M 8.1M 0.0k nvme4n11 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 102.50 1009.2k 900.0k 0.0k 9.9M 8.8M 0.0k nvme4n12 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.60 940.0k 802.8k 0.0k 9.2M 7.8M 0.0k nvme4n13 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 92.90 886.0k 824.8k 0.0k 8.7M 8.1M 0.0k nvme4n14 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 822.8k 862.4k 0.0k 8.0M 8.4M 0.0k nvme4n15 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 876.8k 862.0k 0.0k 8.6M 8.4M 0.0k nvme4n16 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 790.0k 811.6k 0.0k 7.7M 7.9M 0.0k nvme4n17 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 913.2k 932.0k 0.0k 8.9M 9.1M 0.0k nvme4n18 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 914.8k 907.6k 0.0k 8.9M 8.9M 0.0k nvme4n19 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 853.6k 899.6k 0.0k 8.3M 8.8M 0.0k nvme4n20 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 875.6k 889.6k 0.0k 8.6M 8.7M 0.0k nvme8n11 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 954.8k 842.0k 0.0k 9.3M 8.2M 0.0k nvme8n12 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 829.2k 928.0k 0.0k 8.1M 9.1M 0.0k nvme8n13 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.40 954.8k 866.8k 0.0k 9.3M 8.5M 0.0k nvme8n14 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 778.4k 823.6k 0.0k 7.6M 8.0M 0.0k nvme8n15 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 861.2k 900.8k 0.0k 8.4M 8.8M 0.0k nvme8n16 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 900.0k 887.6k 0.0k 8.8M 8.7M 0.0k nvme8n17 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 915.2k 821.6k 0.0k 8.9M 8.0M 0.0k nvme8n18 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 810.8k 854.4k 0.0k 7.9M 8.3M 0.0k nvme8n19 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 888.0k 906.0k 0.0k 8.7M 8.8M 0.0k nvme8n20 2026-02-18T03:25:13.977 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:14.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:14 trial097 ceph-mon[21799]: pgmap v329: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 5.32k op/s 2026-02-18T03:25:14.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:14 trial119 ceph-mon[24143]: pgmap v329: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 5.32k op/s 2026-02-18T03:25:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:14 trial114 ceph-mon[23907]: pgmap v329: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 5.32k op/s 2026-02-18T03:25:15.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3197644435' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:15.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:15 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3197644435' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:15.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:15 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3197644435' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:16.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:16 trial097 ceph-mon[21799]: pgmap v330: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.82k op/s 2026-02-18T03:25:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:16 trial119 ceph-mon[24143]: pgmap v330: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.82k op/s 2026-02-18T03:25:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:16 trial114 ceph-mon[23907]: pgmap v330: 33 pgs: 33 active+clean; 60 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.82k op/s 2026-02-18T03:25:18.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:18 trial097 ceph-mon[21799]: pgmap v331: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 5.19k op/s 2026-02-18T03:25:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:18 trial119 ceph-mon[24143]: pgmap v331: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 5.19k op/s 2026-02-18T03:25:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:18 trial114 ceph-mon[23907]: pgmap v331: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 5.19k op/s 2026-02-18T03:25:19.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1040059225' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:19.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3179843579' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:19.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1040059225' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:19.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3179843579' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:19.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1040059225' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:19.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3179843579' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:20.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:20 trial097 ceph-mon[21799]: pgmap v332: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.98k op/s 2026-02-18T03:25:20.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:20 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3394694942' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:20 trial119 ceph-mon[24143]: pgmap v332: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.98k op/s 2026-02-18T03:25:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:20 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3394694942' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:20 trial114 ceph-mon[23907]: pgmap v332: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.98k op/s 2026-02-18T03:25:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:20 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3394694942' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:22.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:22 trial097 ceph-mon[21799]: pgmap v333: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.70k op/s 2026-02-18T03:25:22.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:22 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1671406811' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:22 trial119 ceph-mon[24143]: pgmap v333: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.70k op/s 2026-02-18T03:25:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:22 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1671406811' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:22 trial114 ceph-mon[23907]: pgmap v333: 33 pgs: 33 active+clean; 60 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 50 MiB/s rd, 52 MiB/s wr, 5.70k op/s 2026-02-18T03:25:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:22 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1671406811' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:23.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:23.495 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:23.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 799.6k 886.8k 0.0k 7.8M 8.7M 0.0k nvme12n1 2026-02-18T03:25:23.495 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 937.2k 822.8k 0.0k 9.2M 8.0M 0.0k nvme12n10 2026-02-18T03:25:23.495 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 749.2k 889.6k 0.0k 7.3M 8.7M 0.0k nvme12n2 2026-02-18T03:25:23.495 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 792.8k 855.2k 0.0k 7.7M 8.4M 0.0k nvme12n3 2026-02-18T03:25:23.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 884.4k 868.8k 0.0k 8.6M 8.5M 0.0k nvme12n4 2026-02-18T03:25:23.495 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 836.0k 868.0k 0.0k 8.2M 8.5M 0.0k nvme12n5 2026-02-18T03:25:23.495 INFO:tasks.workunit.client.0.trial031.stdout: 99.00 948.0k 858.4k 0.0k 9.3M 8.4M 0.0k nvme12n6 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.90 868.8k 880.4k 0.0k 8.5M 8.6M 0.0k nvme12n7 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 822.4k 839.2k 0.0k 8.0M 8.2M 0.0k nvme12n8 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 897.6k 869.2k 0.0k 8.8M 8.5M 0.0k nvme12n9 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 968.4k 803.6k 0.0k 9.5M 7.8M 0.0k nvme4n1 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.40 822.4k 944.8k 0.0k 8.0M 9.2M 0.0k nvme4n10 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 823.2k 840.8k 0.0k 8.0M 8.2M 0.0k nvme4n2 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 98.30 934.8k 842.0k 0.0k 9.1M 8.2M 0.0k nvme4n3 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 86.00 826.0k 758.4k 0.0k 8.1M 7.4M 0.0k nvme4n4 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 846.0k 901.2k 0.0k 8.3M 8.8M 0.0k nvme4n5 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 790.0k 856.0k 0.0k 7.7M 8.4M 0.0k nvme4n6 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 963.6k 914.4k 0.0k 9.4M 8.9M 0.0k nvme4n7 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 887.6k 881.6k 0.0k 8.7M 8.6M 0.0k nvme4n8 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 95.80 930.4k 825.6k 0.0k 9.1M 8.1M 0.0k nvme4n9 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 871.6k 793.2k 0.0k 8.5M 7.7M 0.0k nvme8n1 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 823.2k 862.0k 0.0k 8.0M 8.4M 0.0k nvme8n10 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 828.8k 883.2k 0.0k 8.1M 8.6M 0.0k nvme8n2 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 900.4k 796.8k 0.0k 8.8M 7.8M 0.0k nvme8n3 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 825.2k 771.2k 0.0k 8.1M 7.5M 0.0k nvme8n4 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.40 855.2k 864.4k 0.0k 8.4M 8.4M 0.0k nvme8n5 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 792.4k 849.2k 0.0k 7.7M 8.3M 0.0k nvme8n6 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 825.6k 910.4k 0.0k 8.1M 8.9M 0.0k nvme8n7 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 893.2k 848.8k 0.0k 8.7M 8.3M 0.0k nvme8n8 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 107.50 1.2M 1.2M 0.0k 12.1M 11.7M 0.0k nvme8n9 2026-02-18T03:25:23.496 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:23.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 792.4k 826.0k 0.0k 7.7M 8.1M 0.0k nvme12n11 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 877.2k 865.6k 0.0k 8.6M 8.5M 0.0k nvme12n12 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 795.6k 801.6k 0.0k 7.8M 7.8M 0.0k nvme12n13 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 883.6k 863.2k 0.0k 8.6M 8.4M 0.0k nvme12n14 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 757.2k 827.6k 0.0k 7.4M 8.1M 0.0k nvme12n15 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 804.8k 815.2k 0.0k 7.9M 8.0M 0.0k nvme12n16 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 83.50 688.4k 782.0k 0.0k 6.7M 7.6M 0.0k nvme12n17 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 817.2k 826.0k 0.0k 8.0M 8.1M 0.0k nvme12n18 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 846.0k 876.4k 0.0k 8.3M 8.6M 0.0k nvme12n19 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 874.8k 828.4k 0.0k 8.5M 8.1M 0.0k nvme12n20 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 921.2k 876.4k 0.0k 9.0M 8.6M 0.0k nvme4n11 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 92.70 922.4k 804.0k 0.0k 9.0M 7.9M 0.0k nvme4n12 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 101.10 978.4k 942.4k 0.0k 9.6M 9.2M 0.0k nvme4n13 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 848.4k 826.8k 0.0k 8.3M 8.1M 0.0k nvme4n14 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 99.60 952.4k 942.0k 0.0k 9.3M 9.2M 0.0k nvme4n15 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 87.50 794.0k 838.8k 0.0k 7.8M 8.2M 0.0k nvme4n16 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 909.6k 842.0k 0.0k 8.9M 8.2M 0.0k nvme4n17 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 100.70 928.8k 860.4k 0.0k 9.1M 8.4M 0.0k nvme4n18 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 97.60 908.4k 795.6k 0.0k 8.9M 7.8M 0.0k nvme4n19 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 880.8k 854.4k 0.0k 8.6M 8.3M 0.0k nvme4n20 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 106.50 1.0M 914.4k 0.0k 10.0M 8.9M 0.0k nvme8n11 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 101.00 996.8k 1.1M 0.0k 9.7M 11.1M 0.0k nvme8n12 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 795.6k 832.8k 0.0k 7.8M 8.1M 0.0k nvme8n13 2026-02-18T03:25:23.976 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 858.8k 875.2k 0.0k 8.4M 8.5M 0.0k nvme8n14 2026-02-18T03:25:23.977 INFO:tasks.workunit.client.1.trial078.stdout: 98.60 920.0k 867.2k 0.0k 9.0M 8.5M 0.0k nvme8n15 2026-02-18T03:25:23.977 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 814.0k 881.6k 0.0k 7.9M 8.6M 0.0k nvme8n16 2026-02-18T03:25:23.977 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 871.2k 865.6k 0.0k 8.5M 8.5M 0.0k nvme8n17 2026-02-18T03:25:23.977 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 780.8k 826.4k 0.0k 7.6M 8.1M 0.0k nvme8n18 2026-02-18T03:25:23.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 906.8k 829.6k 0.0k 8.9M 8.1M 0.0k nvme8n19 2026-02-18T03:25:23.977 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 839.2k 877.6k 0.0k 8.2M 8.6M 0.0k nvme8n20 2026-02-18T03:25:23.977 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:24.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:24 trial097 ceph-mon[21799]: pgmap v334: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.35k op/s 2026-02-18T03:25:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:24 trial119 ceph-mon[24143]: pgmap v334: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.35k op/s 2026-02-18T03:25:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:24 trial114 ceph-mon[23907]: pgmap v334: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.35k op/s 2026-02-18T03:25:26.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:26 trial097 ceph-mon[21799]: pgmap v335: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.86k op/s 2026-02-18T03:25:26.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:26 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3316205053' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:26.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:26 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2791496030' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:26 trial119 ceph-mon[24143]: pgmap v335: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.86k op/s 2026-02-18T03:25:26.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:26 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3316205053' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:26.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:26 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2791496030' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:26 trial114 ceph-mon[23907]: pgmap v335: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 53 MiB/s wr, 5.86k op/s 2026-02-18T03:25:26.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:26 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3316205053' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:26.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:26 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2791496030' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:27.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:27 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/4131442457' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:27.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:27 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/4131442457' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:27.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:27 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/4131442457' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:28.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:28 trial097 ceph-mon[21799]: pgmap v336: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 5.21k op/s 2026-02-18T03:25:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:28 trial119 ceph-mon[24143]: pgmap v336: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 5.21k op/s 2026-02-18T03:25:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:28 trial114 ceph-mon[23907]: pgmap v336: 33 pgs: 33 active+clean; 60 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 5.21k op/s 2026-02-18T03:25:29.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:29 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1102343874' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:29.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:29 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1102343874' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:29.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:29 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1102343874' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:30.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:30 trial097 ceph-mon[21799]: pgmap v337: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 54 MiB/s wr, 6.02k op/s 2026-02-18T03:25:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:30 trial119 ceph-mon[24143]: pgmap v337: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 54 MiB/s wr, 6.02k op/s 2026-02-18T03:25:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:30 trial114 ceph-mon[23907]: pgmap v337: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 54 MiB/s wr, 6.02k op/s 2026-02-18T03:25:32.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:32 trial097 ceph-mon[21799]: pgmap v338: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 5.76k op/s 2026-02-18T03:25:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:32 trial119 ceph-mon[24143]: pgmap v338: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 5.76k op/s 2026-02-18T03:25:32.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:32 trial114 ceph-mon[23907]: pgmap v338: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 5.76k op/s 2026-02-18T03:25:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 99.60 960.4k 934.8k 0.0k 9.4M 9.1M 0.0k nvme12n1 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.90 888.4k 861.6k 0.0k 8.7M 8.4M 0.0k nvme12n10 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.60 896.8k 860.8k 0.0k 8.8M 8.4M 0.0k nvme12n2 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.40 844.4k 849.6k 0.0k 8.2M 8.3M 0.0k nvme12n3 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.30 765.2k 823.6k 0.0k 7.5M 8.0M 0.0k nvme12n4 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 827.6k 865.2k 0.0k 8.1M 8.4M 0.0k nvme12n5 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 843.2k 858.0k 0.0k 8.2M 8.4M 0.0k nvme12n6 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.40 1.1M 1.1M 0.0k 10.6M 10.7M 0.0k nvme12n7 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 917.2k 835.6k 0.0k 9.0M 8.2M 0.0k nvme12n8 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 100.20 985.6k 826.4k 0.0k 9.6M 8.1M 0.0k nvme12n9 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.70 868.8k 858.0k 0.0k 8.5M 8.4M 0.0k nvme4n1 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 829.6k 794.8k 0.0k 8.1M 7.8M 0.0k nvme4n10 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 100.40 1011.2k 846.8k 0.0k 9.9M 8.3M 0.0k nvme4n2 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.60 861.2k 956.4k 0.0k 8.4M 9.3M 0.0k nvme4n3 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 821.2k 831.2k 0.0k 8.0M 8.1M 0.0k nvme4n4 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 774.0k 746.4k 0.0k 7.6M 7.3M 0.0k nvme4n5 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 838.8k 824.4k 0.0k 8.2M 8.1M 0.0k nvme4n6 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 101.00 1020.8k 865.2k 0.0k 10.0M 8.4M 0.0k nvme4n7 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 832.0k 768.8k 0.0k 8.1M 7.5M 0.0k nvme4n8 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 876.4k 810.4k 0.0k 8.6M 7.9M 0.0k nvme4n9 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.20 750.8k 787.6k 0.0k 7.3M 7.7M 0.0k nvme8n1 2026-02-18T03:25:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 98.70 952.0k 904.0k 0.0k 9.3M 8.8M 0.0k nvme8n10 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 102.60 1007.6k 926.8k 0.0k 9.8M 9.1M 0.0k nvme8n2 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 99.20 874.0k 922.4k 0.0k 8.5M 9.0M 0.0k nvme8n3 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 835.6k 776.4k 0.0k 8.2M 7.6M 0.0k nvme8n4 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 818.8k 753.2k 0.0k 8.0M 7.4M 0.0k nvme8n5 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 764.8k 815.2k 0.0k 7.5M 8.0M 0.0k nvme8n6 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.40 942.8k 865.2k 0.0k 9.2M 8.4M 0.0k nvme8n7 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 826.4k 830.0k 0.0k 8.1M 8.1M 0.0k nvme8n8 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.4M 1.6M 0.0k 14.3M 15.7M 0.0k nvme8n9 2026-02-18T03:25:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:33.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:33 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3840187421' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:33.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:33 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1791388299' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:33.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:33 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3840187421' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:33.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:33 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1791388299' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:33.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:33 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3840187421' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:33.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:33 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1791388299' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:33.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:33.976 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:33.976 INFO:tasks.workunit.client.1.trial078.stdout: 95.70 906.8k 921.2k 0.0k 8.9M 9.0M 0.0k nvme12n11 2026-02-18T03:25:33.976 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 784.0k 930.4k 0.0k 7.7M 9.1M 0.0k nvme12n12 2026-02-18T03:25:33.976 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 849.2k 834.0k 0.0k 8.3M 8.1M 0.0k nvme12n13 2026-02-18T03:25:33.976 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 951.2k 830.4k 0.0k 9.3M 8.1M 0.0k nvme12n14 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 759.6k 873.6k 0.0k 7.4M 8.5M 0.0k nvme12n15 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 844.4k 778.8k 0.0k 8.2M 7.6M 0.0k nvme12n16 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 97.10 870.8k 902.0k 0.0k 8.5M 8.8M 0.0k nvme12n17 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 830.0k 838.4k 0.0k 8.1M 8.2M 0.0k nvme12n18 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 100.30 953.6k 802.4k 0.0k 9.3M 7.8M 0.0k nvme12n19 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 821.6k 815.2k 0.0k 8.0M 8.0M 0.0k nvme12n20 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 782.4k 797.6k 0.0k 7.6M 7.8M 0.0k nvme4n11 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.00 924.8k 1.0M 0.0k 9.0M 10.3M 0.0k nvme4n12 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 774.0k 854.8k 0.0k 7.6M 8.3M 0.0k nvme4n13 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 798.8k 811.2k 0.0k 7.8M 7.9M 0.0k nvme4n14 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 101.00 876.0k 818.4k 0.0k 8.6M 8.0M 0.0k nvme4n15 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 827.2k 798.4k 0.0k 8.1M 7.8M 0.0k nvme4n16 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 85.20 860.8k 837.2k 0.0k 8.4M 8.2M 0.0k nvme4n17 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 792.4k 839.6k 0.0k 7.7M 8.2M 0.0k nvme4n18 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 100.60 910.8k 968.0k 0.0k 8.9M 9.5M 0.0k nvme4n19 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 776.0k 894.4k 0.0k 7.6M 8.7M 0.0k nvme4n20 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 99.70 1.6M 1.6M 0.0k 16.4M 15.5M 0.0k nvme8n11 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 92.00 1.4M 1.6M 0.0k 13.8M 15.8M 0.0k nvme8n12 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 866.4k 823.6k 0.0k 8.5M 8.0M 0.0k nvme8n13 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 906.0k 793.6k 0.0k 8.8M 7.8M 0.0k nvme8n14 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 904.0k 826.4k 0.0k 8.8M 8.1M 0.0k nvme8n15 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 752.4k 810.0k 0.0k 7.3M 7.9M 0.0k nvme8n16 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 835.6k 925.6k 0.0k 8.2M 9.0M 0.0k nvme8n17 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 95.50 856.4k 923.6k 0.0k 8.4M 9.0M 0.0k nvme8n18 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 800.8k 825.6k 0.0k 7.8M 8.1M 0.0k nvme8n19 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 800.4k 851.6k 0.0k 7.8M 8.3M 0.0k nvme8n20 2026-02-18T03:25:33.977 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:34.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:34 trial097 ceph-mon[21799]: pgmap v339: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.40k op/s 2026-02-18T03:25:34.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:34 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2872249402' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:34 trial119 ceph-mon[24143]: pgmap v339: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.40k op/s 2026-02-18T03:25:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:34 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2872249402' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:34 trial114 ceph-mon[23907]: pgmap v339: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.40k op/s 2026-02-18T03:25:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:34 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2872249402' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:36.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:36 trial097 ceph-mon[21799]: pgmap v340: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 54 MiB/s wr, 5.92k op/s 2026-02-18T03:25:36.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:36 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/573113092' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:36 trial119 ceph-mon[24143]: pgmap v340: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 54 MiB/s wr, 5.92k op/s 2026-02-18T03:25:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:36 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/573113092' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:36.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:36 trial114 ceph-mon[23907]: pgmap v340: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 53 MiB/s rd, 54 MiB/s wr, 5.92k op/s 2026-02-18T03:25:36.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:36 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/573113092' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:38.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:38 trial097 ceph-mon[21799]: pgmap v341: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.25k op/s 2026-02-18T03:25:38.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:38 trial119 ceph-mon[24143]: pgmap v341: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.25k op/s 2026-02-18T03:25:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:38 trial114 ceph-mon[23907]: pgmap v341: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 5.25k op/s 2026-02-18T03:25:40.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:40 trial097 ceph-mon[21799]: pgmap v342: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 55 MiB/s rd, 57 MiB/s wr, 6.08k op/s 2026-02-18T03:25:40.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1148778904' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:40.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:40 trial119 ceph-mon[24143]: pgmap v342: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 55 MiB/s rd, 57 MiB/s wr, 6.08k op/s 2026-02-18T03:25:40.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1148778904' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:40 trial114 ceph-mon[23907]: pgmap v342: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 55 MiB/s rd, 57 MiB/s wr, 6.08k op/s 2026-02-18T03:25:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1148778904' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:41.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/4099081265' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:41.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:41 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/4039325839' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:41.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/4099081265' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:41.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:41 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/4039325839' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:41.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/4099081265' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:41.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:41 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/4039325839' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:42.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:42 trial097 ceph-mon[21799]: pgmap v343: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.23k op/s 2026-02-18T03:25:42.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:42 trial119 ceph-mon[24143]: pgmap v343: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.23k op/s 2026-02-18T03:25:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:42 trial114 ceph-mon[23907]: pgmap v343: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 5.23k op/s 2026-02-18T03:25:43.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 882.0k 814.8k 0.0k 8.6M 8.0M 0.0k nvme12n1 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 842.0k 808.4k 0.0k 8.2M 7.9M 0.0k nvme12n10 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: 86.80 1.2M 1.4M 0.0k 12.0M 14.0M 0.0k nvme12n2 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: 97.80 877.2k 846.0k 0.0k 8.6M 8.3M 0.0k nvme12n3 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 853.6k 882.0k 0.0k 8.3M 8.6M 0.0k nvme12n4 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: 86.50 759.6k 813.6k 0.0k 7.4M 7.9M 0.0k nvme12n5 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: 113.60 1.2M 940.0k 0.0k 11.8M 9.2M 0.0k nvme12n6 2026-02-18T03:25:43.495 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 1.6M 1.5M 0.0k 16.0M 15.2M 0.0k nvme12n7 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 80.90 663.2k 799.6k 0.0k 6.5M 7.8M 0.0k nvme12n8 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 833.6k 861.6k 0.0k 8.1M 8.4M 0.0k nvme12n9 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 841.6k 851.2k 0.0k 8.2M 8.3M 0.0k nvme4n1 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 835.6k 831.2k 0.0k 8.2M 8.1M 0.0k nvme4n10 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 868.0k 830.8k 0.0k 8.5M 8.1M 0.0k nvme4n2 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.4M 1.4M 0.0k 13.8M 14.1M 0.0k nvme4n3 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 810.4k 807.2k 0.0k 7.9M 7.9M 0.0k nvme4n4 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 92.70 858.8k 823.2k 0.0k 8.4M 8.0M 0.0k nvme4n5 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 770.8k 790.0k 0.0k 7.5M 7.7M 0.0k nvme4n6 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 776.4k 842.4k 0.0k 7.6M 8.2M 0.0k nvme4n7 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 783.2k 796.8k 0.0k 7.6M 7.8M 0.0k nvme4n8 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 82.00 745.2k 801.2k 0.0k 7.3M 7.8M 0.0k nvme4n9 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 97.50 958.8k 831.6k 0.0k 9.4M 8.1M 0.0k nvme8n1 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 96.60 1.0M 976.8k 0.0k 10.1M 9.5M 0.0k nvme8n10 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 100.60 1011.2k 1.1M 0.0k 9.9M 11.1M 0.0k nvme8n2 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 105.70 1.4M 1.3M 0.0k 14.4M 13.1M 0.0k nvme8n3 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 880.0k 875.2k 0.0k 8.6M 8.5M 0.0k nvme8n4 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 949.6k 822.8k 0.0k 9.3M 8.0M 0.0k nvme8n5 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 920.0k 778.8k 0.0k 9.0M 7.6M 0.0k nvme8n6 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 791.2k 896.8k 0.0k 7.7M 8.8M 0.0k nvme8n7 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 738.8k 840.0k 0.0k 7.2M 8.2M 0.0k nvme8n8 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 93.60 1.5M 1.4M 0.0k 14.7M 14.3M 0.0k nvme8n9 2026-02-18T03:25:43.496 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:43.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:43 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1644074143' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:43.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:43 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1644074143' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:43 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1644074143' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:43.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.00 888.8k 835.2k 0.0k 8.7M 8.2M 0.0k nvme12n11 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 106.40 953.6k 918.4k 0.0k 9.3M 9.0M 0.0k nvme12n12 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.80 1.0M 938.4k 0.0k 10.2M 9.2M 0.0k nvme12n13 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 1.0M 1003.2k 0.0k 10.2M 9.8M 0.0k nvme12n14 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 838.8k 914.8k 0.0k 8.2M 8.9M 0.0k nvme12n15 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 98.40 935.6k 847.6k 0.0k 9.1M 8.3M 0.0k nvme12n16 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 96.40 874.8k 894.4k 0.0k 8.5M 8.7M 0.0k nvme12n17 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 890.0k 787.2k 0.0k 8.7M 7.7M 0.0k nvme12n18 2026-02-18T03:25:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 97.10 895.2k 916.8k 0.0k 8.7M 9.0M 0.0k nvme12n19 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.90 1.0M 1.0M 0.0k 10.1M 10.2M 0.0k nvme12n20 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 810.0k 838.0k 0.0k 7.9M 8.2M 0.0k nvme4n11 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 103.80 1.8M 1.6M 0.0k 18.4M 15.5M 0.0k nvme4n12 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 920.8k 775.2k 0.0k 9.0M 7.6M 0.0k nvme4n13 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 102.90 1.3M 1.3M 0.0k 13.1M 13.4M 0.0k nvme4n14 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 980.0k 1013.6k 0.0k 9.6M 9.9M 0.0k nvme4n15 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 989.2k 1.0M 0.0k 9.7M 10.5M 0.0k nvme4n16 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 908.4k 755.6k 0.0k 8.9M 7.4M 0.0k nvme4n17 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 102.70 1.0M 1.1M 0.0k 10.2M 10.8M 0.0k nvme4n18 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 874.0k 807.6k 0.0k 8.5M 7.9M 0.0k nvme4n19 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 828.4k 772.0k 0.0k 8.1M 7.5M 0.0k nvme4n20 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 1.6M 1.5M 0.0k 16.2M 14.6M 0.0k nvme8n11 2026-02-18T03:25:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 1.4M 1.6M 0.0k 14.0M 15.7M 0.0k nvme8n12 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 860.4k 845.6k 0.0k 8.4M 8.3M 0.0k nvme8n13 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 873.2k 874.4k 0.0k 8.5M 8.5M 0.0k nvme8n14 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 882.8k 758.4k 0.0k 8.6M 7.4M 0.0k nvme8n15 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 930.4k 805.6k 0.0k 9.1M 7.9M 0.0k nvme8n16 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 101.20 1.3M 1.3M 0.0k 13.5M 13.1M 0.0k nvme8n17 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.4M 1.4M 0.0k 13.8M 14.4M 0.0k nvme8n18 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 842.8k 754.4k 0.0k 8.2M 7.4M 0.0k nvme8n19 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 929.2k 833.2k 0.0k 9.1M 8.1M 0.0k nvme8n20 2026-02-18T03:25:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:44.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:44 trial097 ceph-mon[21799]: pgmap v344: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 5.42k op/s 2026-02-18T03:25:44.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:44 trial119 ceph-mon[24143]: pgmap v344: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 5.42k op/s 2026-02-18T03:25:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:44 trial114 ceph-mon[23907]: pgmap v344: 33 pgs: 33 active+clean; 60 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 5.42k op/s 2026-02-18T03:25:46.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:46 trial097 ceph-mon[21799]: pgmap v345: 33 pgs: 33 active+clean; 60 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 57 MiB/s rd, 59 MiB/s wr, 5.95k op/s 2026-02-18T03:25:46.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:46 trial119 ceph-mon[24143]: pgmap v345: 33 pgs: 33 active+clean; 60 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 57 MiB/s rd, 59 MiB/s wr, 5.95k op/s 2026-02-18T03:25:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:46 trial114 ceph-mon[23907]: pgmap v345: 33 pgs: 33 active+clean; 60 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 57 MiB/s rd, 59 MiB/s wr, 5.95k op/s 2026-02-18T03:25:47.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:47 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3713843280' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:47.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:47 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3713843280' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:47.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:47 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3713843280' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:48.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:48 trial097 ceph-mon[21799]: pgmap v346: 33 pgs: 33 active+clean; 60 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 5.24k op/s 2026-02-18T03:25:48.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/413887749' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:48.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:48 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1585692825' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:48.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:48 trial119 ceph-mon[24143]: pgmap v346: 33 pgs: 33 active+clean; 60 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 5.24k op/s 2026-02-18T03:25:48.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/413887749' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:48.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:48 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1585692825' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:48 trial114 ceph-mon[23907]: pgmap v346: 33 pgs: 33 active+clean; 60 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 5.24k op/s 2026-02-18T03:25:48.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/413887749' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:48.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:48 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1585692825' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:50.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:50 trial097 ceph-mon[21799]: pgmap v347: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 64 MiB/s wr, 6.09k op/s 2026-02-18T03:25:50.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:50 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1974298561' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:50 trial119 ceph-mon[24143]: pgmap v347: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 64 MiB/s wr, 6.09k op/s 2026-02-18T03:25:50.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:50 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1974298561' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:50 trial114 ceph-mon[23907]: pgmap v347: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 64 MiB/s wr, 6.09k op/s 2026-02-18T03:25:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:50 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1974298561' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:52.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:52 trial097 ceph-mon[21799]: pgmap v348: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 55 MiB/s rd, 58 MiB/s wr, 5.26k op/s 2026-02-18T03:25:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:52 trial119 ceph-mon[24143]: pgmap v348: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 55 MiB/s rd, 58 MiB/s wr, 5.26k op/s 2026-02-18T03:25:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:52 trial114 ceph-mon[23907]: pgmap v348: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 55 MiB/s rd, 58 MiB/s wr, 5.26k op/s 2026-02-18T03:25:53.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:53.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 100.40 1.2M 1.2M 0.0k 12.5M 11.6M 0.0k nvme12n1 2026-02-18T03:25:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 798.8k 868.8k 0.0k 7.8M 8.5M 0.0k nvme12n10 2026-02-18T03:25:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.4M 1.6M 0.0k 14.3M 15.5M 0.0k nvme12n2 2026-02-18T03:25:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 1.3M 1.1M 0.0k 12.6M 11.4M 0.0k nvme12n3 2026-02-18T03:25:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 998.4k 866.8k 0.0k 9.8M 8.5M 0.0k nvme12n4 2026-02-18T03:25:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 85.70 749.6k 815.2k 0.0k 7.3M 8.0M 0.0k nvme12n5 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.40 1.7M 1.5M 0.0k 17.2M 15.3M 0.0k nvme12n6 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 1.6M 1.4M 0.0k 15.7M 14.3M 0.0k nvme12n7 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.3M 1.1M 0.0k 12.6M 11.4M 0.0k nvme12n8 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 103.70 1.1M 985.2k 0.0k 10.9M 9.6M 0.0k nvme12n9 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.20 723.6k 881.2k 0.0k 7.1M 8.6M 0.0k nvme4n1 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.40 804.0k 788.0k 0.0k 7.9M 7.7M 0.0k nvme4n10 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 99.80 1.2M 1.1M 0.0k 12.1M 10.9M 0.0k nvme4n2 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 1.5M 1.5M 0.0k 15.4M 14.8M 0.0k nvme4n3 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1.0M 1.1M 0.0k 10.5M 11.2M 0.0k nvme4n4 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 1.4M 1.5M 0.0k 13.9M 14.7M 0.0k nvme4n5 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 810.4k 863.6k 0.0k 7.9M 8.4M 0.0k nvme4n6 2026-02-18T03:25:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 852.8k 885.2k 0.0k 8.3M 8.6M 0.0k nvme4n7 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 99.60 862.4k 888.0k 0.0k 8.4M 8.7M 0.0k nvme4n8 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 99.30 899.6k 838.0k 0.0k 8.8M 8.2M 0.0k nvme4n9 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.4M 1.3M 0.0k 13.7M 13.3M 0.0k nvme8n1 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.70 1.5M 1.6M 0.0k 14.6M 15.7M 0.0k nvme8n10 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.50 1.3M 1.5M 0.0k 13.2M 14.9M 0.0k nvme8n2 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.5M 1.5M 0.0k 14.9M 14.6M 0.0k nvme8n3 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 98.70 1.1M 1.2M 0.0k 11.2M 12.1M 0.0k nvme8n4 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1.3M 1.4M 0.0k 13.3M 14.4M 0.0k nvme8n5 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 776.0k 842.0k 0.0k 7.6M 8.2M 0.0k nvme8n6 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.3M 1.4M 0.0k 13.4M 13.8M 0.0k nvme8n7 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.20 930.0k 984.8k 0.0k 9.1M 9.6M 0.0k nvme8n8 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.3M 1.5M 0.0k 12.6M 15.1M 0.0k nvme8n9 2026-02-18T03:25:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:25:53.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:53.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:25:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1.1M 1.1M 0.0k 11.5M 10.5M 0.0k nvme12n11 2026-02-18T03:25:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.0M 1.3M 0.0k 10.5M 12.7M 0.0k nvme12n12 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 1.5M 1.6M 0.0k 15.2M 15.6M 0.0k nvme12n13 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.6M 1.4M 0.0k 15.7M 14.2M 0.0k nvme12n14 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 106.20 1018.8k 929.6k 0.0k 9.9M 9.1M 0.0k nvme12n15 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 103.40 1.3M 1.0M 0.0k 13.0M 10.3M 0.0k nvme12n16 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.4M 1.3M 0.0k 13.7M 13.2M 0.0k nvme12n17 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 800.0k 903.6k 0.0k 7.8M 8.8M 0.0k nvme12n18 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 1.0M 954.8k 0.0k 10.4M 9.3M 0.0k nvme12n19 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.3M 1.6M 0.0k 13.2M 16.1M 0.0k nvme12n20 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.20 1.0M 1.2M 0.0k 10.5M 11.7M 0.0k nvme4n11 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.6M 1.4M 0.0k 16.2M 14.3M 0.0k nvme4n12 2026-02-18T03:25:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.90 756.0k 833.6k 0.0k 7.4M 8.1M 0.0k nvme4n13 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.4M 1.5M 0.0k 13.8M 14.5M 0.0k nvme4n14 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.5M 1.5M 0.0k 15.3M 15.5M 0.0k nvme4n15 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.5M 1.4M 0.0k 14.9M 14.5M 0.0k nvme4n16 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 865.2k 905.2k 0.0k 8.4M 8.8M 0.0k nvme4n17 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 1.7M 1.5M 0.0k 16.5M 15.2M 0.0k nvme4n18 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 1.3M 1.3M 0.0k 12.6M 13.0M 0.0k nvme4n19 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 827.2k 821.2k 0.0k 8.1M 8.0M 0.0k nvme4n20 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 98.10 1.7M 1.5M 0.0k 16.8M 15.1M 0.0k nvme8n11 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.70 1.5M 1.5M 0.0k 14.9M 15.2M 0.0k nvme8n12 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 101.30 1013.2k 964.0k 0.0k 9.9M 9.4M 0.0k nvme8n13 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 97.70 1008.8k 1.1M 0.0k 9.9M 10.5M 0.0k nvme8n14 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.4M 1.5M 0.0k 14.1M 15.0M 0.0k nvme8n15 2026-02-18T03:25:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 839.2k 826.8k 0.0k 8.2M 8.1M 0.0k nvme8n16 2026-02-18T03:25:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 1.6M 1.5M 0.0k 15.8M 14.8M 0.0k nvme8n17 2026-02-18T03:25:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 1.6M 1.5M 0.0k 16.5M 15.0M 0.0k nvme8n18 2026-02-18T03:25:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 103.60 1.1M 936.4k 0.0k 10.6M 9.1M 0.0k nvme8n19 2026-02-18T03:25:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 98.30 936.4k 940.8k 0.0k 9.1M 9.2M 0.0k nvme8n20 2026-02-18T03:25:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:25:54.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:54 trial097 ceph-mon[21799]: pgmap v349: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 68 MiB/s wr, 5.99k op/s 2026-02-18T03:25:54.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:54 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2187117530' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:54.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:54 trial119 ceph-mon[24143]: pgmap v349: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 68 MiB/s wr, 5.99k op/s 2026-02-18T03:25:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:54 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2187117530' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:54 trial114 ceph-mon[23907]: pgmap v349: 33 pgs: 33 active+clean; 60 GiB data, 95 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 68 MiB/s wr, 5.99k op/s 2026-02-18T03:25:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:54 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2187117530' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:55.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3622324483' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:55.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:55 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3037692603' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3622324483' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:55.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:55 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3037692603' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:55.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3622324483' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:55.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:55 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3037692603' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:56.898 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:56 trial097 ceph-mon[21799]: pgmap v350: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 5.93k op/s 2026-02-18T03:25:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:56 trial119 ceph-mon[24143]: pgmap v350: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 5.93k op/s 2026-02-18T03:25:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:56 trial114 ceph-mon[23907]: pgmap v350: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 5.93k op/s 2026-02-18T03:25:57.899 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:57 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2045618515' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:57.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:57 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2045618515' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:57.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:57 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2045618515' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:25:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:25:58 trial119 ceph-mon[24143]: pgmap v351: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 5.23k op/s 2026-02-18T03:25:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:25:58 trial114 ceph-mon[23907]: pgmap v351: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 5.23k op/s 2026-02-18T03:25:59.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:25:58 trial097 ceph-mon[21799]: pgmap v351: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 5.23k op/s 2026-02-18T03:26:00.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:00 trial119 ceph-mon[24143]: pgmap v352: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 76 MiB/s rd, 80 MiB/s wr, 6.03k op/s 2026-02-18T03:26:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:00 trial114 ceph-mon[23907]: pgmap v352: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 76 MiB/s rd, 80 MiB/s wr, 6.03k op/s 2026-02-18T03:26:01.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:00 trial097 ceph-mon[21799]: pgmap v352: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 76 MiB/s rd, 80 MiB/s wr, 6.03k op/s 2026-02-18T03:26:01.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:01 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2396216317' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:01.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:01 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2396216317' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:02.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2396216317' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: pgmap v353: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.17k op/s 2026-02-18T03:26:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1625909235' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/556601427' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:02.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.966 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:02 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: pgmap v353: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.17k op/s 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1625909235' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/556601427' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:02.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:02 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: pgmap v353: 33 pgs: 33 active+clean; 60 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.17k op/s 2026-02-18T03:26:03.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1625909235' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:03.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/556601427' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:03.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:02 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:03.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.40 1.4M 1.4M 0.0k 14.3M 14.3M 0.0k nvme12n1 2026-02-18T03:26:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 82.20 1.2M 1.5M 0.0k 12.0M 14.6M 0.0k nvme12n10 2026-02-18T03:26:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 1.5M 1.4M 0.0k 15.2M 14.4M 0.0k nvme12n2 2026-02-18T03:26:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.5M 1.6M 0.0k 14.5M 15.7M 0.0k nvme12n3 2026-02-18T03:26:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.00 1.4M 1.2M 0.0k 13.5M 12.3M 0.0k nvme12n4 2026-02-18T03:26:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 82.70 784.8k 760.8k 0.0k 7.7M 7.4M 0.0k nvme12n5 2026-02-18T03:26:03.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.5M 1.5M 0.0k 14.7M 14.9M 0.0k nvme12n6 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.4M 1.4M 0.0k 14.1M 13.5M 0.0k nvme12n7 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.60 1.3M 1.5M 0.0k 12.5M 15.0M 0.0k nvme12n8 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.4M 1.5M 0.0k 14.4M 15.4M 0.0k nvme12n9 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.5M 1.4M 0.0k 15.1M 13.8M 0.0k nvme4n1 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.00 1.3M 1.4M 0.0k 12.6M 14.4M 0.0k nvme4n10 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.5M 1.4M 0.0k 15.1M 14.3M 0.0k nvme4n2 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.5M 1.4M 0.0k 15.1M 14.4M 0.0k nvme4n3 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.4M 1.4M 0.0k 14.2M 14.1M 0.0k nvme4n4 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 1.5M 1.4M 0.0k 14.8M 13.7M 0.0k nvme4n5 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 1.1M 1.1M 0.0k 11.2M 11.5M 0.0k nvme4n6 2026-02-18T03:26:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.30 1.4M 1.4M 0.0k 13.8M 13.7M 0.0k nvme4n7 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 85.30 1.4M 1.4M 0.0k 13.9M 14.2M 0.0k nvme4n8 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 86.20 1.3M 1.3M 0.0k 12.6M 12.7M 0.0k nvme4n9 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.5M 1.4M 0.0k 15.3M 14.0M 0.0k nvme8n1 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.5M 1.4M 0.0k 14.8M 14.0M 0.0k nvme8n10 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 1.3M 1.5M 0.0k 12.7M 15.0M 0.0k nvme8n2 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.5M 1.4M 0.0k 14.5M 13.9M 0.0k nvme8n3 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 86.10 1.3M 1.4M 0.0k 13.4M 14.1M 0.0k nvme8n4 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.4M 1.4M 0.0k 13.8M 13.7M 0.0k nvme8n5 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.1M 1011.2k 0.0k 11.1M 9.9M 0.0k nvme8n6 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.5M 1.4M 0.0k 14.8M 13.9M 0.0k nvme8n7 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.5M 1.4M 0.0k 14.8M 13.9M 0.0k nvme8n8 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 101.30 1.7M 1.4M 0.0k 16.6M 14.1M 0.0k nvme8n9 2026-02-18T03:26:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: Adjusting osd_memory_target on trial097 to 79951M 2026-02-18T03:26:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: Adjusting osd_memory_target on trial114 to 84047M 2026-02-18T03:26:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: Adjusting osd_memory_target on trial119 to 84047M 2026-02-18T03:26:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial031", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: Adjusting osd_memory_target on trial097 to 79951M 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: Adjusting osd_memory_target on trial114 to 84047M 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: Adjusting osd_memory_target on trial119 to 84047M 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial031", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:03.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:03.975 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:03.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:03.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 1.5M 1.5M 0.0k 14.6M 14.8M 0.0k nvme12n11 2026-02-18T03:26:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 85.70 1.4M 1.4M 0.0k 13.6M 14.3M 0.0k nvme12n12 2026-02-18T03:26:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.3M 1.3M 0.0k 12.8M 13.5M 0.0k nvme12n13 2026-02-18T03:26:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 1.4M 1.5M 0.0k 14.3M 14.7M 0.0k nvme12n14 2026-02-18T03:26:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 88.70 1.4M 1.5M 0.0k 14.1M 14.6M 0.0k nvme12n15 2026-02-18T03:26:03.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1.6M 1.5M 0.0k 16.3M 15.2M 0.0k nvme12n16 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 1.5M 1.5M 0.0k 15.4M 14.6M 0.0k nvme12n17 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 81.40 797.2k 832.0k 0.0k 7.8M 8.1M 0.0k nvme12n18 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.80 1.3M 1.4M 0.0k 13.3M 14.2M 0.0k nvme12n19 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 1.3M 1.5M 0.0k 13.0M 15.0M 0.0k nvme12n20 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.6M 1.4M 0.0k 15.5M 14.1M 0.0k nvme4n11 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.5M 1.4M 0.0k 15.1M 14.2M 0.0k nvme4n12 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 860.0k 956.4k 0.0k 8.4M 9.3M 0.0k nvme4n13 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.5M 1.5M 0.0k 14.7M 15.5M 0.0k nvme4n14 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.20 1.5M 1.4M 0.0k 14.7M 13.8M 0.0k nvme4n15 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.10 1.4M 1.4M 0.0k 14.1M 14.2M 0.0k nvme4n16 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 774.8k 795.6k 0.0k 7.6M 7.8M 0.0k nvme4n17 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.4M 1.4M 0.0k 14.4M 14.4M 0.0k nvme4n18 2026-02-18T03:26:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.4M 1.5M 0.0k 13.7M 15.1M 0.0k nvme4n19 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 859.6k 860.0k 0.0k 8.4M 8.4M 0.0k nvme4n20 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.4M 1.5M 0.0k 14.2M 14.9M 0.0k nvme8n11 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 1.3M 1.4M 0.0k 13.4M 14.3M 0.0k nvme8n12 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.5M 1.5M 0.0k 15.1M 14.5M 0.0k nvme8n13 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.4M 1.4M 0.0k 13.8M 14.2M 0.0k nvme8n14 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.50 1.4M 1.3M 0.0k 14.0M 13.2M 0.0k nvme8n15 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.40 1.2M 1.1M 0.0k 11.7M 11.2M 0.0k nvme8n16 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.70 1.4M 1.3M 0.0k 14.2M 12.9M 0.0k nvme8n17 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.90 1.5M 1.5M 0.0k 15.4M 15.1M 0.0k nvme8n18 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 1.3M 1.5M 0.0k 13.0M 14.6M 0.0k nvme8n19 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 1.4M 1.5M 0.0k 14.3M 14.8M 0.0k nvme8n20 2026-02-18T03:26:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:04.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: Adjusting osd_memory_target on trial097 to 79951M 2026-02-18T03:26:04.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:04.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:04.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: Adjusting osd_memory_target on trial114 to 84047M 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: Adjusting osd_memory_target on trial119 to 84047M 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial031", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:26:04.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:04.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:04 trial119 ceph-mon[24143]: pgmap v354: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 5.77k op/s 2026-02-18T03:26:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:04 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3769117041' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:04 trial114 ceph-mon[23907]: pgmap v354: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 5.77k op/s 2026-02-18T03:26:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:04 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3769117041' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:05.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:04 trial097 ceph-mon[21799]: pgmap v354: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 5.77k op/s 2026-02-18T03:26:05.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:04 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3769117041' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:06 trial119 ceph-mon[24143]: pgmap v355: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 84 MiB/s wr, 5.72k op/s 2026-02-18T03:26:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:06 trial114 ceph-mon[23907]: pgmap v355: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 84 MiB/s wr, 5.72k op/s 2026-02-18T03:26:07.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:06 trial097 ceph-mon[21799]: pgmap v355: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 84 MiB/s wr, 5.72k op/s 2026-02-18T03:26:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:08 trial119 ceph-mon[24143]: pgmap v356: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 72 MiB/s rd, 76 MiB/s wr, 5.03k op/s 2026-02-18T03:26:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:08 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2492319412' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:08 trial114 ceph-mon[23907]: pgmap v356: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 72 MiB/s rd, 76 MiB/s wr, 5.03k op/s 2026-02-18T03:26:08.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:08 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2492319412' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:09.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:08 trial097 ceph-mon[21799]: pgmap v356: 33 pgs: 33 active+clean; 60 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 72 MiB/s rd, 76 MiB/s wr, 5.03k op/s 2026-02-18T03:26:09.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:08 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2492319412' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:09.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1835110773' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:09.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:09 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1276338231' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:09.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1835110773' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:09.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:09 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1276338231' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:10.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1835110773' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:10.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:09 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1276338231' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:10.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:10 trial119 ceph-mon[24143]: pgmap v357: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 83 MiB/s rd, 89 MiB/s wr, 5.82k op/s 2026-02-18T03:26:10.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:10 trial114 ceph-mon[23907]: pgmap v357: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 83 MiB/s rd, 89 MiB/s wr, 5.82k op/s 2026-02-18T03:26:11.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:10 trial097 ceph-mon[21799]: pgmap v357: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 83 MiB/s rd, 89 MiB/s wr, 5.82k op/s 2026-02-18T03:26:11.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:11 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2018602948' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:11.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:11 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2018602948' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:12.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:11 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2018602948' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:12 trial119 ceph-mon[24143]: pgmap v358: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 77 MiB/s wr, 5.04k op/s 2026-02-18T03:26:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:12 trial114 ceph-mon[23907]: pgmap v358: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 77 MiB/s wr, 5.04k op/s 2026-02-18T03:26:13.149 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:12 trial097 ceph-mon[21799]: pgmap v358: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 77 MiB/s wr, 5.04k op/s 2026-02-18T03:26:13.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:13.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 84.30 1.4M 1.3M 0.0k 13.5M 13.2M 0.0k nvme12n1 2026-02-18T03:26:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 81.70 1.3M 1.4M 0.0k 12.6M 13.9M 0.0k nvme12n10 2026-02-18T03:26:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.4M 1.4M 0.0k 14.1M 14.1M 0.0k nvme12n2 2026-02-18T03:26:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.4M 1.4M 0.0k 14.2M 14.2M 0.0k nvme12n3 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.5M 1.4M 0.0k 14.9M 13.8M 0.0k nvme12n4 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.1M 1.2M 0.0k 10.9M 11.6M 0.0k nvme12n5 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.50 1.4M 1.4M 0.0k 13.6M 14.2M 0.0k nvme12n6 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.4M 1.4M 0.0k 13.7M 14.2M 0.0k nvme12n7 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.4M 1.3M 0.0k 13.8M 13.1M 0.0k nvme12n8 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.80 1.3M 1.4M 0.0k 13.1M 14.1M 0.0k nvme12n9 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.40 1.3M 1.3M 0.0k 13.3M 13.4M 0.0k nvme4n1 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.5M 1.4M 0.0k 15.0M 14.4M 0.0k nvme4n10 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 1.5M 1.3M 0.0k 15.1M 13.3M 0.0k nvme4n2 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 1.6M 1.4M 0.0k 15.8M 13.8M 0.0k nvme4n3 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.3M 1.6M 0.0k 13.3M 15.7M 0.0k nvme4n4 2026-02-18T03:26:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.4M 1.5M 0.0k 13.9M 14.7M 0.0k nvme4n5 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.40 1.3M 1.4M 0.0k 13.5M 13.8M 0.0k nvme4n6 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.4M 1.4M 0.0k 14.2M 14.3M 0.0k nvme4n7 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.6M 1.4M 0.0k 15.6M 14.3M 0.0k nvme4n8 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.80 1.2M 1.4M 0.0k 12.4M 13.9M 0.0k nvme4n9 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.6M 1.3M 0.0k 15.5M 13.2M 0.0k nvme8n1 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.4M 1.4M 0.0k 14.1M 14.0M 0.0k nvme8n10 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.00 1.4M 1.4M 0.0k 13.9M 14.0M 0.0k nvme8n2 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.4M 1.6M 0.0k 14.0M 15.8M 0.0k nvme8n3 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.5M 1.4M 0.0k 14.8M 13.6M 0.0k nvme8n4 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 1.5M 1.4M 0.0k 15.3M 14.1M 0.0k nvme8n5 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 1.5M 1.4M 0.0k 14.8M 13.8M 0.0k nvme8n6 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.5M 1.4M 0.0k 15.2M 14.0M 0.0k nvme8n7 2026-02-18T03:26:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.00 1.4M 1.4M 0.0k 14.1M 14.0M 0.0k nvme8n8 2026-02-18T03:26:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 100.80 1.6M 1.4M 0.0k 15.5M 14.5M 0.0k nvme8n9 2026-02-18T03:26:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:13.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:13.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:13.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.5M 1.4M 0.0k 14.6M 13.8M 0.0k nvme12n11 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.5M 1.5M 0.0k 14.6M 14.7M 0.0k nvme12n12 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 1.4M 1.5M 0.0k 14.4M 14.6M 0.0k nvme12n13 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 1.4M 1.3M 0.0k 14.2M 13.2M 0.0k nvme12n14 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 1.5M 1.5M 0.0k 15.4M 14.6M 0.0k nvme12n15 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 1.5M 1.5M 0.0k 14.6M 14.8M 0.0k nvme12n16 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1.5M 1.4M 0.0k 14.7M 13.6M 0.0k nvme12n17 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 1.5M 1.5M 0.0k 15.0M 14.6M 0.0k nvme12n18 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 1.3M 1.4M 0.0k 13.4M 14.4M 0.0k nvme12n19 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.4M 1.4M 0.0k 14.3M 14.5M 0.0k nvme12n20 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.4M 1.4M 0.0k 13.9M 14.4M 0.0k nvme4n11 2026-02-18T03:26:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.30 1.3M 1.4M 0.0k 12.8M 13.9M 0.0k nvme4n12 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 84.00 1.4M 1.4M 0.0k 14.2M 14.2M 0.0k nvme4n13 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.4M 1.5M 0.0k 13.6M 14.6M 0.0k nvme4n14 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.4M 1.5M 0.0k 13.6M 15.2M 0.0k nvme4n15 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.4M 1.5M 0.0k 14.1M 15.4M 0.0k nvme4n16 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.4M 1.4M 0.0k 14.0M 13.6M 0.0k nvme4n17 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.4M 1.4M 0.0k 14.4M 13.8M 0.0k nvme4n18 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.6M 1.4M 0.0k 15.6M 13.9M 0.0k nvme4n19 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1.3M 1.4M 0.0k 13.0M 14.2M 0.0k nvme4n20 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.4M 1.5M 0.0k 13.6M 15.0M 0.0k nvme8n11 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 1.3M 1.5M 0.0k 12.7M 15.1M 0.0k nvme8n12 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.5M 1.4M 0.0k 14.7M 14.3M 0.0k nvme8n13 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 1.3M 1.4M 0.0k 13.4M 13.6M 0.0k nvme8n14 2026-02-18T03:26:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.5M 1.5M 0.0k 15.3M 14.7M 0.0k nvme8n15 2026-02-18T03:26:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.5M 1.4M 0.0k 15.3M 13.6M 0.0k nvme8n16 2026-02-18T03:26:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.5M 1.5M 0.0k 15.5M 15.0M 0.0k nvme8n17 2026-02-18T03:26:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.5M 1.5M 0.0k 15.2M 14.6M 0.0k nvme8n18 2026-02-18T03:26:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.5M 1.4M 0.0k 14.6M 14.3M 0.0k nvme8n19 2026-02-18T03:26:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.4M 1.4M 0.0k 14.1M 14.3M 0.0k nvme8n20 2026-02-18T03:26:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:14.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:14 trial119 ceph-mon[24143]: pgmap v359: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 83 MiB/s rd, 88 MiB/s wr, 5.70k op/s 2026-02-18T03:26:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:14 trial114 ceph-mon[23907]: pgmap v359: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 83 MiB/s rd, 88 MiB/s wr, 5.70k op/s 2026-02-18T03:26:15.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:14 trial097 ceph-mon[21799]: pgmap v359: 33 pgs: 33 active+clean; 60 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 83 MiB/s rd, 88 MiB/s wr, 5.70k op/s 2026-02-18T03:26:15.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:15 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/4270293299' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:15.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:15 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/4270293299' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:16.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/4270293299' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:16 trial119 ceph-mon[24143]: pgmap v360: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 88 MiB/s wr, 5.70k op/s 2026-02-18T03:26:16.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/782194717' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:16.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:16 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2631610436' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:16 trial114 ceph-mon[23907]: pgmap v360: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 88 MiB/s wr, 5.70k op/s 2026-02-18T03:26:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/782194717' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:16.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:16 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2631610436' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:17.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:16 trial097 ceph-mon[21799]: pgmap v360: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 88 MiB/s wr, 5.70k op/s 2026-02-18T03:26:17.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/782194717' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:17.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:16 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2631610436' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:18.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:18 trial119 ceph-mon[24143]: pgmap v361: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 79 MiB/s wr, 5.04k op/s 2026-02-18T03:26:18.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3630075569' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:18 trial114 ceph-mon[23907]: pgmap v361: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 79 MiB/s wr, 5.04k op/s 2026-02-18T03:26:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3630075569' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:19.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:18 trial097 ceph-mon[21799]: pgmap v361: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 79 MiB/s wr, 5.04k op/s 2026-02-18T03:26:19.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3630075569' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:20 trial119 ceph-mon[24143]: pgmap v362: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 87 MiB/s rd, 91 MiB/s wr, 5.83k op/s 2026-02-18T03:26:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:20 trial114 ceph-mon[23907]: pgmap v362: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 87 MiB/s rd, 91 MiB/s wr, 5.83k op/s 2026-02-18T03:26:21.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:20 trial097 ceph-mon[21799]: pgmap v362: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 87 MiB/s rd, 91 MiB/s wr, 5.83k op/s 2026-02-18T03:26:22.952 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:22 trial097 ceph-mon[21799]: pgmap v363: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.05k op/s 2026-02-18T03:26:22.952 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:22 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2962804047' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:22 trial119 ceph-mon[24143]: pgmap v363: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.05k op/s 2026-02-18T03:26:22.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:22 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2962804047' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:22 trial114 ceph-mon[23907]: pgmap v363: 33 pgs: 33 active+clean; 60 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.05k op/s 2026-02-18T03:26:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:22 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2962804047' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:23.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:23.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.10 1.3M 1.3M 0.0k 13.4M 13.3M 0.0k nvme12n1 2026-02-18T03:26:23.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.10 1.4M 1.4M 0.0k 13.7M 13.5M 0.0k nvme12n10 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.4M 1.3M 0.0k 13.6M 12.6M 0.0k nvme12n2 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.4M 1.4M 0.0k 13.7M 14.3M 0.0k nvme12n3 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 1.4M 1.4M 0.0k 13.9M 14.4M 0.0k nvme12n4 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 84.90 1.4M 1.4M 0.0k 14.5M 13.8M 0.0k nvme12n5 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 1.5M 1.4M 0.0k 15.4M 13.8M 0.0k nvme12n6 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.4M 1.4M 0.0k 14.3M 13.7M 0.0k nvme12n7 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.4M 1.3M 0.0k 14.5M 12.9M 0.0k nvme12n8 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1.5M 1.4M 0.0k 14.6M 14.2M 0.0k nvme12n9 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 1.5M 1.5M 0.0k 15.2M 15.0M 0.0k nvme4n1 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 1.3M 1.3M 0.0k 12.9M 12.8M 0.0k nvme4n10 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 1.4M 1.3M 0.0k 13.8M 13.4M 0.0k nvme4n2 2026-02-18T03:26:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 97.30 1.5M 1.4M 0.0k 15.0M 13.9M 0.0k nvme4n3 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.5M 1.4M 0.0k 15.4M 14.3M 0.0k nvme4n4 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.4M 1.5M 0.0k 14.2M 15.0M 0.0k nvme4n5 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.10 1.4M 1.4M 0.0k 13.5M 13.8M 0.0k nvme4n6 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.5M 1.5M 0.0k 14.8M 15.1M 0.0k nvme4n7 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.70 1.3M 1.4M 0.0k 13.1M 13.7M 0.0k nvme4n8 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.10 1.6M 1.4M 0.0k 15.7M 14.2M 0.0k nvme4n9 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.4M 1.4M 0.0k 14.4M 14.3M 0.0k nvme8n1 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.4M 1.5M 0.0k 14.1M 14.6M 0.0k nvme8n10 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.3M 1.4M 0.0k 13.2M 14.2M 0.0k nvme8n2 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.3M 1.4M 0.0k 13.3M 14.0M 0.0k nvme8n3 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.60 1.2M 1.4M 0.0k 12.5M 13.7M 0.0k nvme8n4 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.20 1.2M 1.4M 0.0k 12.4M 14.0M 0.0k nvme8n5 2026-02-18T03:26:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.4M 1.4M 0.0k 14.2M 13.8M 0.0k nvme8n6 2026-02-18T03:26:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.4M 1.4M 0.0k 14.1M 13.7M 0.0k nvme8n7 2026-02-18T03:26:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.30 1.5M 1.4M 0.0k 14.5M 13.5M 0.0k nvme8n8 2026-02-18T03:26:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.70 1.5M 1.4M 0.0k 15.5M 14.1M 0.0k nvme8n9 2026-02-18T03:26:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:23.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2720558023' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:23.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:23 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3314766037' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:23.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2720558023' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:23.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:23 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3314766037' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:23.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:23.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 82.90 1.3M 1.3M 0.0k 12.7M 13.1M 0.0k nvme12n11 2026-02-18T03:26:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 1.4M 1.4M 0.0k 13.6M 13.7M 0.0k nvme12n12 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 1.4M 1.3M 0.0k 13.5M 13.4M 0.0k nvme12n13 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.4M 1.4M 0.0k 14.2M 14.3M 0.0k nvme12n14 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.3M 1.3M 0.0k 13.4M 13.0M 0.0k nvme12n15 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 84.70 1.3M 1.4M 0.0k 12.9M 13.7M 0.0k nvme12n16 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 1.4M 1.3M 0.0k 13.8M 13.4M 0.0k nvme12n17 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.3M 1.5M 0.0k 13.3M 14.6M 0.0k nvme12n18 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.40 1.4M 1.4M 0.0k 14.3M 14.0M 0.0k nvme12n19 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.6M 1.5M 0.0k 15.7M 14.7M 0.0k nvme12n20 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 1.7M 1.5M 0.0k 16.9M 15.3M 0.0k nvme4n11 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 97.60 1.5M 1.4M 0.0k 15.4M 14.2M 0.0k nvme4n12 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.5M 1.4M 0.0k 14.7M 13.9M 0.0k nvme4n13 2026-02-18T03:26:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 1.4M 1.5M 0.0k 13.7M 15.0M 0.0k nvme4n14 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 1.5M 1.4M 0.0k 15.0M 14.4M 0.0k nvme4n15 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.5M 1.4M 0.0k 15.3M 13.9M 0.0k nvme4n16 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 84.10 1.3M 1.4M 0.0k 13.3M 14.0M 0.0k nvme4n17 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 1.3M 1.3M 0.0k 13.4M 13.5M 0.0k nvme4n18 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.5M 1.3M 0.0k 15.4M 13.5M 0.0k nvme4n19 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 81.60 1.3M 1.3M 0.0k 13.4M 12.9M 0.0k nvme4n20 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 1.4M 1.4M 0.0k 14.4M 14.4M 0.0k nvme8n11 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.00 1.5M 1.4M 0.0k 14.6M 13.7M 0.0k nvme8n12 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.3M 1.5M 0.0k 13.3M 15.2M 0.0k nvme8n13 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1.3M 1.3M 0.0k 13.3M 13.1M 0.0k nvme8n14 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.3M 1.5M 0.0k 13.2M 14.6M 0.0k nvme8n15 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 1.4M 1.4M 0.0k 13.5M 13.6M 0.0k nvme8n16 2026-02-18T03:26:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 1.4M 1.4M 0.0k 13.7M 13.9M 0.0k nvme8n17 2026-02-18T03:26:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1.5M 1.4M 0.0k 14.8M 14.0M 0.0k nvme8n18 2026-02-18T03:26:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 82.20 1.2M 1.5M 0.0k 11.7M 14.7M 0.0k nvme8n19 2026-02-18T03:26:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.5M 1.4M 0.0k 14.7M 13.9M 0.0k nvme8n20 2026-02-18T03:26:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:24.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2720558023' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:24.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:23 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3314766037' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:24 trial119 ceph-mon[24143]: pgmap v364: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 88 MiB/s wr, 5.69k op/s 2026-02-18T03:26:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:24 trial114 ceph-mon[23907]: pgmap v364: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 88 MiB/s wr, 5.69k op/s 2026-02-18T03:26:25.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:24 trial097 ceph-mon[21799]: pgmap v364: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 88 MiB/s wr, 5.69k op/s 2026-02-18T03:26:25.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:25 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/46993058' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:25.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:25 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/46993058' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:26.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:25 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/46993058' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:26 trial119 ceph-mon[24143]: pgmap v365: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 87 MiB/s wr, 5.66k op/s 2026-02-18T03:26:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:26 trial114 ceph-mon[23907]: pgmap v365: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 87 MiB/s wr, 5.66k op/s 2026-02-18T03:26:27.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:26 trial097 ceph-mon[21799]: pgmap v365: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 87 MiB/s wr, 5.66k op/s 2026-02-18T03:26:28.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:28 trial119 ceph-mon[24143]: pgmap v366: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 78 MiB/s wr, 5.03k op/s 2026-02-18T03:26:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:28 trial114 ceph-mon[23907]: pgmap v366: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 78 MiB/s wr, 5.03k op/s 2026-02-18T03:26:29.150 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:28 trial097 ceph-mon[21799]: pgmap v366: 33 pgs: 33 active+clean; 60 GiB data, 100 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 78 MiB/s wr, 5.03k op/s 2026-02-18T03:26:29.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:29 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3524297879' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:29.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:29 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3524297879' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:30.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:29 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3524297879' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:30.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:30 trial119 ceph-mon[24143]: pgmap v367: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 90 MiB/s wr, 5.81k op/s 2026-02-18T03:26:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1633554292' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:30 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/335287723' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:30 trial114 ceph-mon[23907]: pgmap v367: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 90 MiB/s wr, 5.81k op/s 2026-02-18T03:26:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1633554292' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:30.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:30 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/335287723' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:31.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:30 trial097 ceph-mon[21799]: pgmap v367: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 90 MiB/s wr, 5.81k op/s 2026-02-18T03:26:31.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1633554292' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:31.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:30 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/335287723' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:32 trial119 ceph-mon[24143]: pgmap v368: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 78 MiB/s wr, 5.02k op/s 2026-02-18T03:26:32.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:32 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2802101923' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:32.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:32 trial114 ceph-mon[23907]: pgmap v368: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 78 MiB/s wr, 5.02k op/s 2026-02-18T03:26:32.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:32 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2802101923' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:33.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:32 trial097 ceph-mon[21799]: pgmap v368: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 78 MiB/s wr, 5.02k op/s 2026-02-18T03:26:33.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:32 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2802101923' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:33.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 82.70 1.2M 1.3M 0.0k 12.0M 13.3M 0.0k nvme12n1 2026-02-18T03:26:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 1.4M 1.5M 0.0k 14.4M 14.6M 0.0k nvme12n10 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.3M 1.4M 0.0k 13.3M 14.1M 0.0k nvme12n2 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.5M 1.4M 0.0k 14.5M 13.8M 0.0k nvme12n3 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.4M 1.4M 0.0k 14.5M 13.6M 0.0k nvme12n4 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 85.50 1.4M 1.3M 0.0k 14.1M 13.3M 0.0k nvme12n5 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 1.4M 1.4M 0.0k 14.3M 13.9M 0.0k nvme12n6 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.4M 1.3M 0.0k 14.0M 13.4M 0.0k nvme12n7 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 1.4M 1.4M 0.0k 14.0M 13.8M 0.0k nvme12n8 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 1.4M 1.3M 0.0k 13.5M 13.1M 0.0k nvme12n9 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.4M 1.4M 0.0k 14.1M 14.4M 0.0k nvme4n1 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.4M 1.5M 0.0k 14.5M 14.7M 0.0k nvme4n10 2026-02-18T03:26:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.3M 1.5M 0.0k 13.4M 14.5M 0.0k nvme4n2 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.3M 1.3M 0.0k 13.2M 12.7M 0.0k nvme4n3 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 1.4M 1.5M 0.0k 13.8M 15.4M 0.0k nvme4n4 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.5M 1.4M 0.0k 14.7M 14.0M 0.0k nvme4n5 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.4M 1.4M 0.0k 14.5M 14.4M 0.0k nvme4n6 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.4M 1.3M 0.0k 13.9M 13.1M 0.0k nvme4n7 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.00 1.4M 1.3M 0.0k 13.7M 12.8M 0.0k nvme4n8 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 1.5M 1.2M 0.0k 14.5M 12.4M 0.0k nvme4n9 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.3M 1.4M 0.0k 13.0M 14.3M 0.0k nvme8n1 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.4M 1.3M 0.0k 13.6M 13.4M 0.0k nvme8n10 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.3M 1.5M 0.0k 13.0M 15.1M 0.0k nvme8n2 2026-02-18T03:26:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.4M 1.4M 0.0k 14.0M 14.4M 0.0k nvme8n3 2026-02-18T03:26:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 1.4M 1.3M 0.0k 14.0M 12.8M 0.0k nvme8n4 2026-02-18T03:26:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 1.4M 1.3M 0.0k 13.5M 13.2M 0.0k nvme8n5 2026-02-18T03:26:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 1.4M 1.5M 0.0k 14.3M 14.6M 0.0k nvme8n6 2026-02-18T03:26:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.90 1.4M 1.3M 0.0k 14.1M 13.4M 0.0k nvme8n7 2026-02-18T03:26:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 1.4M 1.4M 0.0k 14.2M 14.0M 0.0k nvme8n8 2026-02-18T03:26:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1.4M 1.2M 0.0k 13.7M 12.4M 0.0k nvme8n9 2026-02-18T03:26:33.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:33.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:33.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 1.2M 1.4M 0.0k 12.2M 13.7M 0.0k nvme12n11 2026-02-18T03:26:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 1.4M 1.3M 0.0k 14.0M 13.1M 0.0k nvme12n12 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.5M 1.4M 0.0k 14.7M 13.5M 0.0k nvme12n13 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.4M 1.4M 0.0k 13.8M 14.4M 0.0k nvme12n14 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.50 1.5M 1.3M 0.0k 14.7M 12.6M 0.0k nvme12n15 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1.5M 1.3M 0.0k 14.9M 13.2M 0.0k nvme12n16 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 1.4M 1.3M 0.0k 13.6M 13.5M 0.0k nvme12n17 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.5M 1.3M 0.0k 14.8M 13.0M 0.0k nvme12n18 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 1.4M 1.4M 0.0k 13.8M 13.7M 0.0k nvme12n19 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.30 1.6M 1.4M 0.0k 16.1M 13.6M 0.0k nvme12n20 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.4M 1.4M 0.0k 13.9M 14.2M 0.0k nvme4n11 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1.4M 1.4M 0.0k 13.6M 13.7M 0.0k nvme4n12 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 1.5M 1.3M 0.0k 15.3M 13.0M 0.0k nvme4n13 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.60 1.2M 1.4M 0.0k 12.2M 13.9M 0.0k nvme4n14 2026-02-18T03:26:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 1.3M 1.4M 0.0k 13.4M 14.4M 0.0k nvme4n15 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.50 1.4M 1.2M 0.0k 14.0M 12.4M 0.0k nvme4n16 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.5M 1.4M 0.0k 14.8M 14.3M 0.0k nvme4n17 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.5M 1.4M 0.0k 14.6M 14.2M 0.0k nvme4n18 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.4M 1.2M 0.0k 14.1M 12.5M 0.0k nvme4n19 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 81.60 1.2M 1.2M 0.0k 11.9M 12.1M 0.0k nvme4n20 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1.2M 1.4M 0.0k 12.5M 14.1M 0.0k nvme8n11 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.3M 1.4M 0.0k 13.3M 13.8M 0.0k nvme8n12 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1.4M 1.4M 0.0k 14.3M 14.4M 0.0k nvme8n13 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 1.3M 1.3M 0.0k 12.8M 12.9M 0.0k nvme8n14 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.3M 1.3M 0.0k 13.4M 13.2M 0.0k nvme8n15 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.4M 1.5M 0.0k 14.2M 14.6M 0.0k nvme8n16 2026-02-18T03:26:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.4M 1.4M 0.0k 14.3M 13.6M 0.0k nvme8n17 2026-02-18T03:26:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 86.60 1.3M 1.3M 0.0k 12.9M 13.3M 0.0k nvme8n18 2026-02-18T03:26:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.3M 1.3M 0.0k 13.3M 13.2M 0.0k nvme8n19 2026-02-18T03:26:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.4M 1.4M 0.0k 14.0M 13.7M 0.0k nvme8n20 2026-02-18T03:26:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:34 trial114 ceph-mon[23907]: pgmap v369: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 87 MiB/s wr, 5.66k op/s 2026-02-18T03:26:35.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:34 trial097 ceph-mon[21799]: pgmap v369: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 87 MiB/s wr, 5.66k op/s 2026-02-18T03:26:35.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:34 trial119 ceph-mon[24143]: pgmap v369: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 87 MiB/s wr, 5.66k op/s 2026-02-18T03:26:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:36 trial114 ceph-mon[23907]: pgmap v370: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.63k op/s 2026-02-18T03:26:36.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:36 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/74944998' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:37.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:36 trial097 ceph-mon[21799]: pgmap v370: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.63k op/s 2026-02-18T03:26:37.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:36 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/74944998' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:37.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:36 trial119 ceph-mon[24143]: pgmap v370: 33 pgs: 33 active+clean; 60 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.63k op/s 2026-02-18T03:26:37.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:36 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/74944998' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:37.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2556640830' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:37.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:37 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1503502763' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:38.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2556640830' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:38.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:37 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1503502763' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:38.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2556640830' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:38.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:37 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1503502763' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:38 trial114 ceph-mon[23907]: pgmap v371: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.01k op/s 2026-02-18T03:26:39.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:38 trial097 ceph-mon[21799]: pgmap v371: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.01k op/s 2026-02-18T03:26:39.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:38 trial119 ceph-mon[24143]: pgmap v371: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.01k op/s 2026-02-18T03:26:40.114 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:39 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1417137837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:40.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:39 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1417137837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:40.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:39 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1417137837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:41.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:40 trial097 ceph-mon[21799]: pgmap v372: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 88 MiB/s wr, 5.79k op/s 2026-02-18T03:26:41.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:40 trial119 ceph-mon[24143]: pgmap v372: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 88 MiB/s wr, 5.79k op/s 2026-02-18T03:26:41.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:40 trial114 ceph-mon[23907]: pgmap v372: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 84 MiB/s rd, 88 MiB/s wr, 5.79k op/s 2026-02-18T03:26:43.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:42 trial097 ceph-mon[21799]: pgmap v373: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 72 MiB/s rd, 76 MiB/s wr, 5.02k op/s 2026-02-18T03:26:43.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:42 trial119 ceph-mon[24143]: pgmap v373: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 72 MiB/s rd, 76 MiB/s wr, 5.02k op/s 2026-02-18T03:26:43.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:42 trial114 ceph-mon[23907]: pgmap v373: 33 pgs: 33 active+clean; 60 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 72 MiB/s rd, 76 MiB/s wr, 5.02k op/s 2026-02-18T03:26:43.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:43.501 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.3M 1.4M 0.0k 13.2M 14.1M 0.0k nvme12n1 2026-02-18T03:26:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 83.70 1.3M 1.2M 0.0k 13.1M 12.1M 0.0k nvme12n10 2026-02-18T03:26:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.3M 1.4M 0.0k 13.4M 14.1M 0.0k nvme12n2 2026-02-18T03:26:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 1.6M 1.4M 0.0k 15.8M 14.0M 0.0k nvme12n3 2026-02-18T03:26:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.4M 1.4M 0.0k 13.6M 14.3M 0.0k nvme12n4 2026-02-18T03:26:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 85.40 1.4M 1.3M 0.0k 14.0M 13.2M 0.0k nvme12n5 2026-02-18T03:26:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 1.5M 1.3M 0.0k 14.8M 13.2M 0.0k nvme12n6 2026-02-18T03:26:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.50 1.6M 1.4M 0.0k 15.7M 14.2M 0.0k nvme12n7 2026-02-18T03:26:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.3M 1.4M 0.0k 13.4M 14.4M 0.0k nvme12n8 2026-02-18T03:26:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 86.30 1.3M 1.3M 0.0k 12.7M 13.0M 0.0k nvme12n9 2026-02-18T03:26:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 93.70 1.5M 1.4M 0.0k 14.9M 13.6M 0.0k nvme4n1 2026-02-18T03:26:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 86.30 1.4M 1.5M 0.0k 13.7M 14.6M 0.0k nvme4n10 2026-02-18T03:26:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.5M 1.3M 0.0k 14.8M 13.3M 0.0k nvme4n2 2026-02-18T03:26:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 1.2M 1.5M 0.0k 12.0M 14.7M 0.0k nvme4n3 2026-02-18T03:26:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 1.3M 1.5M 0.0k 13.1M 14.8M 0.0k nvme4n4 2026-02-18T03:26:43.503 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 1.3M 1.3M 0.0k 13.4M 13.1M 0.0k nvme4n5 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 88.80 1.4M 1.3M 0.0k 14.4M 13.4M 0.0k nvme4n6 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.3M 1.3M 0.0k 12.8M 13.0M 0.0k nvme4n7 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.4M 1.4M 0.0k 13.7M 13.9M 0.0k nvme4n8 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.4M 1.3M 0.0k 14.2M 13.0M 0.0k nvme4n9 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 85.30 1.3M 1.4M 0.0k 12.8M 13.6M 0.0k nvme8n1 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 1.4M 1.4M 0.0k 14.1M 14.4M 0.0k nvme8n10 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.3M 1.4M 0.0k 13.4M 13.6M 0.0k nvme8n2 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.4M 1.4M 0.0k 14.0M 13.6M 0.0k nvme8n3 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 1.2M 1.4M 0.0k 12.1M 13.9M 0.0k nvme8n4 2026-02-18T03:26:43.504 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.4M 1.4M 0.0k 13.6M 13.5M 0.0k nvme8n5 2026-02-18T03:26:43.505 INFO:tasks.workunit.client.0.trial031.stdout: 84.80 1.3M 1.4M 0.0k 12.9M 13.7M 0.0k nvme8n6 2026-02-18T03:26:43.505 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 1.4M 1.4M 0.0k 13.6M 13.5M 0.0k nvme8n7 2026-02-18T03:26:43.505 INFO:tasks.workunit.client.0.trial031.stdout: 94.20 1.5M 1.4M 0.0k 15.4M 14.4M 0.0k nvme8n8 2026-02-18T03:26:43.505 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.4M 1.3M 0.0k 13.8M 13.4M 0.0k nvme8n9 2026-02-18T03:26:43.505 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:43.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:43.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.3M 1.4M 0.0k 13.1M 13.8M 0.0k nvme12n11 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.20 1.4M 1.3M 0.0k 13.6M 13.3M 0.0k nvme12n12 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 1.4M 1.3M 0.0k 13.8M 12.9M 0.0k nvme12n13 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.3M 1.4M 0.0k 13.2M 13.9M 0.0k nvme12n14 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.60 1.3M 1.3M 0.0k 12.9M 13.0M 0.0k nvme12n15 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.5M 1.3M 0.0k 14.6M 13.5M 0.0k nvme12n16 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1.3M 1.3M 0.0k 13.1M 12.8M 0.0k nvme12n17 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 82.00 1.3M 1.3M 0.0k 12.8M 12.9M 0.0k nvme12n18 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.4M 1.3M 0.0k 13.7M 13.4M 0.0k nvme12n19 2026-02-18T03:26:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 1.4M 1.4M 0.0k 13.5M 13.5M 0.0k nvme12n20 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.5M 1.4M 0.0k 14.6M 14.3M 0.0k nvme4n11 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 98.90 1.6M 1.4M 0.0k 16.0M 14.1M 0.0k nvme4n12 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 1.4M 1.4M 0.0k 13.5M 13.6M 0.0k nvme4n13 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.4M 1.3M 0.0k 14.0M 13.3M 0.0k nvme4n14 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.5M 1.4M 0.0k 15.0M 13.8M 0.0k nvme4n15 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.3M 1.5M 0.0k 13.2M 14.6M 0.0k nvme4n16 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 1.3M 1.4M 0.0k 13.5M 13.5M 0.0k nvme4n17 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.4M 1.4M 0.0k 13.7M 13.7M 0.0k nvme4n18 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 1.2M 1.4M 0.0k 12.4M 14.4M 0.0k nvme4n19 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.70 1.4M 1.3M 0.0k 14.1M 13.4M 0.0k nvme4n20 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.70 1.2M 1.3M 0.0k 12.4M 12.8M 0.0k nvme8n11 2026-02-18T03:26:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.2M 1.5M 0.0k 12.4M 14.7M 0.0k nvme8n12 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.30 1.4M 1.5M 0.0k 14.0M 14.5M 0.0k nvme8n13 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.40 1.3M 1.4M 0.0k 13.2M 13.7M 0.0k nvme8n14 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.4M 1.4M 0.0k 13.9M 13.8M 0.0k nvme8n15 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.00 1.4M 1.4M 0.0k 13.7M 14.4M 0.0k nvme8n16 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.4M 1.4M 0.0k 14.1M 14.0M 0.0k nvme8n17 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 97.20 1.5M 1.4M 0.0k 14.9M 14.1M 0.0k nvme8n18 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.60 1.6M 1.3M 0.0k 15.7M 12.8M 0.0k nvme8n19 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1.3M 1.4M 0.0k 13.4M 14.2M 0.0k nvme8n20 2026-02-18T03:26:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:44.151 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:43 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3355402769' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:44.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:43 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3355402769' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:44.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:43 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3355402769' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:45.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:44 trial097 ceph-mon[21799]: pgmap v374: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 85 MiB/s wr, 5.68k op/s 2026-02-18T03:26:45.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/333589714' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:45.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:44 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1209220244' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:45.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:44 trial119 ceph-mon[24143]: pgmap v374: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 85 MiB/s wr, 5.68k op/s 2026-02-18T03:26:45.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/333589714' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:45.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:44 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1209220244' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:45.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:44 trial114 ceph-mon[23907]: pgmap v374: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 85 MiB/s wr, 5.68k op/s 2026-02-18T03:26:45.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/333589714' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:45.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:44 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1209220244' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:47.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:46 trial097 ceph-mon[21799]: pgmap v375: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.69k op/s 2026-02-18T03:26:47.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/635051459' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:47.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:46 trial119 ceph-mon[24143]: pgmap v375: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.69k op/s 2026-02-18T03:26:47.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/635051459' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:47.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:46 trial114 ceph-mon[23907]: pgmap v375: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.69k op/s 2026-02-18T03:26:47.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/635051459' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:49.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:48 trial097 ceph-mon[21799]: pgmap v376: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.09k op/s 2026-02-18T03:26:49.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:48 trial119 ceph-mon[24143]: pgmap v376: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.09k op/s 2026-02-18T03:26:49.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:48 trial114 ceph-mon[23907]: pgmap v376: 33 pgs: 33 active+clean; 60 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.09k op/s 2026-02-18T03:26:51.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:50 trial097 ceph-mon[21799]: pgmap v377: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 88 MiB/s wr, 5.89k op/s 2026-02-18T03:26:51.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:50 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/958601788' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:51.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:50 trial119 ceph-mon[24143]: pgmap v377: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 88 MiB/s wr, 5.89k op/s 2026-02-18T03:26:51.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:50 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/958601788' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:51.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:50 trial114 ceph-mon[23907]: pgmap v377: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 85 MiB/s rd, 88 MiB/s wr, 5.89k op/s 2026-02-18T03:26:51.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:50 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/958601788' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:52.053 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:51 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/537009304' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:52.054 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:51 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/600815477' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:52.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:51 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/537009304' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:52.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:51 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/600815477' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:52.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:51 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/537009304' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:52.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:51 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/600815477' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:53.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:52 trial097 ceph-mon[21799]: pgmap v378: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.10k op/s 2026-02-18T03:26:53.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:52 trial119 ceph-mon[24143]: pgmap v378: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.10k op/s 2026-02-18T03:26:53.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:52 trial114 ceph-mon[23907]: pgmap v378: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.10k op/s 2026-02-18T03:26:53.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:53.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:53.497 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.3M 1.3M 0.0k 13.5M 13.3M 0.0k nvme12n1 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 94.00 1.6M 1.3M 0.0k 15.7M 13.4M 0.0k nvme12n10 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.80 1.4M 1.4M 0.0k 13.8M 13.5M 0.0k nvme12n2 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 1.2M 1.3M 0.0k 12.1M 13.1M 0.0k nvme12n3 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 84.00 1.2M 1.3M 0.0k 12.4M 13.3M 0.0k nvme12n4 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.00 1.4M 1.2M 0.0k 13.9M 12.4M 0.0k nvme12n5 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.50 1.4M 1.3M 0.0k 13.5M 13.3M 0.0k nvme12n6 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 94.80 1.4M 1.5M 0.0k 14.2M 14.7M 0.0k nvme12n7 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.10 1.3M 1.3M 0.0k 13.5M 13.0M 0.0k nvme12n8 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.4M 1.4M 0.0k 14.5M 14.0M 0.0k nvme12n9 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 1.3M 1.3M 0.0k 12.7M 12.6M 0.0k nvme4n1 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.4M 1.4M 0.0k 13.6M 13.6M 0.0k nvme4n10 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.90 1.3M 1.4M 0.0k 13.4M 13.5M 0.0k nvme4n2 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 1.3M 1.4M 0.0k 13.0M 13.8M 0.0k nvme4n3 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.4M 1.4M 0.0k 14.2M 14.0M 0.0k nvme4n4 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 1.3M 1.4M 0.0k 13.1M 14.0M 0.0k nvme4n5 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.60 1.5M 1.3M 0.0k 14.8M 13.4M 0.0k nvme4n6 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.3M 1.4M 0.0k 13.3M 14.0M 0.0k nvme4n7 2026-02-18T03:26:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.90 1.4M 1.4M 0.0k 13.8M 13.6M 0.0k nvme4n8 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 1.3M 1.4M 0.0k 12.8M 14.0M 0.0k nvme4n9 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.4M 1.4M 0.0k 13.8M 14.2M 0.0k nvme8n1 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 103.30 1.7M 1.4M 0.0k 17.1M 13.8M 0.0k nvme8n10 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.3M 1.3M 0.0k 12.9M 12.8M 0.0k nvme8n2 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.2M 1.3M 0.0k 12.4M 13.5M 0.0k nvme8n3 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 83.50 1.2M 1.3M 0.0k 12.1M 12.7M 0.0k nvme8n4 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.50 1.4M 1.3M 0.0k 14.0M 13.0M 0.0k nvme8n5 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.3M 1.3M 0.0k 13.4M 13.5M 0.0k nvme8n6 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.80 1.4M 1.3M 0.0k 13.9M 13.1M 0.0k nvme8n7 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.3M 1.4M 0.0k 12.9M 13.6M 0.0k nvme8n8 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.3M 1.4M 0.0k 13.0M 13.7M 0.0k nvme8n9 2026-02-18T03:26:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:26:53.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:53.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:26:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.70 1.4M 1.4M 0.0k 14.1M 13.6M 0.0k nvme12n11 2026-02-18T03:26:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 1.3M 1.4M 0.0k 13.1M 13.6M 0.0k nvme12n12 2026-02-18T03:26:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.4M 1.3M 0.0k 14.0M 13.0M 0.0k nvme12n13 2026-02-18T03:26:53.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 1.2M 1.4M 0.0k 12.1M 13.9M 0.0k nvme12n14 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.60 1.3M 1.4M 0.0k 12.9M 13.5M 0.0k nvme12n15 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 1.4M 1.3M 0.0k 14.2M 12.8M 0.0k nvme12n16 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 1.4M 1.3M 0.0k 13.9M 13.2M 0.0k nvme12n17 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.90 1.4M 1.3M 0.0k 13.7M 13.4M 0.0k nvme12n18 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 1.4M 1.4M 0.0k 13.9M 13.6M 0.0k nvme12n19 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.3M 1.3M 0.0k 13.4M 13.3M 0.0k nvme12n20 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.4M 1.3M 0.0k 14.4M 12.8M 0.0k nvme4n11 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 1.3M 1.4M 0.0k 12.7M 13.7M 0.0k nvme4n12 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.4M 1.2M 0.0k 14.1M 12.0M 0.0k nvme4n13 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.4M 1.3M 0.0k 13.7M 13.2M 0.0k nvme4n14 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 1.3M 1.4M 0.0k 12.8M 13.6M 0.0k nvme4n15 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 82.20 1.1M 1.2M 0.0k 11.5M 12.3M 0.0k nvme4n16 2026-02-18T03:26:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.4M 1.4M 0.0k 14.1M 13.8M 0.0k nvme4n17 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.4M 1.3M 0.0k 13.7M 13.5M 0.0k nvme4n18 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.2M 1.4M 0.0k 12.4M 13.9M 0.0k nvme4n19 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 78.90 1.2M 1.4M 0.0k 12.0M 14.2M 0.0k nvme4n20 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.80 1.4M 1.3M 0.0k 13.6M 13.2M 0.0k nvme8n11 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.80 1.5M 1.3M 0.0k 14.5M 13.0M 0.0k nvme8n12 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 1.4M 1.3M 0.0k 13.5M 12.8M 0.0k nvme8n13 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.3M 1.4M 0.0k 12.7M 13.8M 0.0k nvme8n14 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 1.3M 1.4M 0.0k 13.5M 13.6M 0.0k nvme8n15 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 1.3M 1.4M 0.0k 12.6M 13.7M 0.0k nvme8n16 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.3M 1.3M 0.0k 13.2M 12.8M 0.0k nvme8n17 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 1.3M 1.4M 0.0k 12.6M 13.7M 0.0k nvme8n18 2026-02-18T03:26:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.40 1.4M 1.3M 0.0k 13.8M 13.2M 0.0k nvme8n19 2026-02-18T03:26:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 1.4M 1.4M 0.0k 13.5M 13.5M 0.0k nvme8n20 2026-02-18T03:26:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:26:54.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1187812786' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:54.152 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:53 trial097 ceph-mon[21799]: pgmap v379: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.72k op/s 2026-02-18T03:26:54.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1187812786' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:54.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:53 trial119 ceph-mon[24143]: pgmap v379: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.72k op/s 2026-02-18T03:26:54.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1187812786' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:54.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:53 trial114 ceph-mon[23907]: pgmap v379: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 82 MiB/s rd, 86 MiB/s wr, 5.72k op/s 2026-02-18T03:26:56.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:56 trial097 ceph-mon[21799]: pgmap v380: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 85 MiB/s wr, 5.67k op/s 2026-02-18T03:26:56.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:56 trial119 ceph-mon[24143]: pgmap v380: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 85 MiB/s wr, 5.67k op/s 2026-02-18T03:26:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:56 trial114 ceph-mon[23907]: pgmap v380: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 85 MiB/s wr, 5.67k op/s 2026-02-18T03:26:57.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:57 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1165009643' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:57.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:57 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1165009643' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:57.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:57 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1165009643' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:58.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:58 trial097 ceph-mon[21799]: pgmap v381: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 75 MiB/s wr, 5.02k op/s 2026-02-18T03:26:58.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2771052137' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:58.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:26:58 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2428318814' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:58 trial119 ceph-mon[24143]: pgmap v381: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 75 MiB/s wr, 5.02k op/s 2026-02-18T03:26:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2771052137' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:26:58 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2428318814' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:58 trial114 ceph-mon[23907]: pgmap v381: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 75 MiB/s wr, 5.02k op/s 2026-02-18T03:26:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2771052137' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:26:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:26:58 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2428318814' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:00.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:00 trial097 ceph-mon[21799]: pgmap v382: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.15k op/s 2026-02-18T03:27:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:00 trial119 ceph-mon[24143]: pgmap v382: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.15k op/s 2026-02-18T03:27:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:00 trial114 ceph-mon[23907]: pgmap v382: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.15k op/s 2026-02-18T03:27:01.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/347955564' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:01.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:01 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/347955564' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:01.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:01 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/347955564' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:02.874 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:02 trial114 ceph-mon[23907]: pgmap v383: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 4.97k op/s 2026-02-18T03:27:02.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:02 trial097 ceph-mon[21799]: pgmap v383: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 4.97k op/s 2026-02-18T03:27:02.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:02 trial119 ceph-mon[24143]: pgmap v383: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 4.97k op/s 2026-02-18T03:27:03.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.3M 1.3M 0.0k 13.1M 12.8M 0.0k nvme12n1 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 85.20 1.3M 1.3M 0.0k 12.6M 12.8M 0.0k nvme12n10 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 89.40 1.3M 1.3M 0.0k 12.9M 13.0M 0.0k nvme12n2 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 1.5M 1.3M 0.0k 15.3M 13.0M 0.0k nvme12n3 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.3M 1.4M 0.0k 12.6M 13.6M 0.0k nvme12n4 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 80.40 1.2M 1.2M 0.0k 12.1M 12.1M 0.0k nvme12n5 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 1.3M 1.2M 0.0k 13.3M 11.7M 0.0k nvme12n6 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 1.3M 1.2M 0.0k 12.6M 12.1M 0.0k nvme12n7 2026-02-18T03:27:03.497 INFO:tasks.workunit.client.0.trial031.stdout: 85.00 1.2M 1.3M 0.0k 11.7M 12.6M 0.0k nvme12n8 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 84.30 1.3M 1.2M 0.0k 13.0M 12.4M 0.0k nvme12n9 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.5M 1.4M 0.0k 15.2M 13.6M 0.0k nvme4n1 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 84.50 1.3M 1.2M 0.0k 12.5M 12.4M 0.0k nvme4n10 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.4M 1.3M 0.0k 14.0M 12.6M 0.0k nvme4n2 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 97.90 1.5M 1.3M 0.0k 15.2M 12.8M 0.0k nvme4n3 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.40 1.3M 1.2M 0.0k 13.4M 12.4M 0.0k nvme4n4 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 1.2M 1.3M 0.0k 12.1M 12.5M 0.0k nvme4n5 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.20 1.3M 1.4M 0.0k 12.6M 13.6M 0.0k nvme4n6 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 1.3M 1.4M 0.0k 12.8M 13.8M 0.0k nvme4n7 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.4M 1.4M 0.0k 13.9M 13.7M 0.0k nvme4n8 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 82.70 1.2M 1.3M 0.0k 12.1M 12.8M 0.0k nvme4n9 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.50 1.1M 1.2M 0.0k 11.3M 12.5M 0.0k nvme8n1 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.10 1.2M 1.3M 0.0k 11.7M 13.4M 0.0k nvme8n10 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.50 1.3M 1.4M 0.0k 12.8M 14.1M 0.0k nvme8n2 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.4M 1.4M 0.0k 13.7M 13.7M 0.0k nvme8n3 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.3M 1.3M 0.0k 13.1M 13.3M 0.0k nvme8n4 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.70 1.3M 1.3M 0.0k 12.8M 13.2M 0.0k nvme8n5 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.10 1.2M 1.3M 0.0k 12.2M 13.2M 0.0k nvme8n6 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.70 1.2M 1.2M 0.0k 12.0M 12.2M 0.0k nvme8n7 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.4M 1.3M 0.0k 13.9M 13.0M 0.0k nvme8n8 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 97.20 1.4M 1.4M 0.0k 14.0M 13.7M 0.0k nvme8n9 2026-02-18T03:27:03.498 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:03.902 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:27:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:03 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:03 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:03 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:03.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:03.983 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.2M 1.2M 0.0k 12.3M 12.1M 0.0k nvme12n11 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 1.2M 1.3M 0.0k 11.9M 12.9M 0.0k nvme12n12 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 92.70 1.4M 1.3M 0.0k 14.1M 12.7M 0.0k nvme12n13 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 1.3M 1.2M 0.0k 13.4M 12.4M 0.0k nvme12n14 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 83.40 1.2M 1.3M 0.0k 11.8M 13.0M 0.0k nvme12n15 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 86.40 1.3M 1.2M 0.0k 12.6M 12.5M 0.0k nvme12n16 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 1.4M 1.3M 0.0k 14.2M 13.4M 0.0k nvme12n17 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 86.10 1.3M 1.4M 0.0k 12.8M 13.6M 0.0k nvme12n18 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.4M 1.3M 0.0k 13.6M 12.9M 0.0k nvme12n19 2026-02-18T03:27:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 1.3M 1.3M 0.0k 13.4M 13.5M 0.0k nvme12n20 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.3M 1.3M 0.0k 13.5M 12.9M 0.0k nvme4n11 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 1.3M 1.2M 0.0k 12.6M 12.1M 0.0k nvme4n12 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1.3M 1.3M 0.0k 12.7M 12.7M 0.0k nvme4n13 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.3M 1.3M 0.0k 13.4M 13.3M 0.0k nvme4n14 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 1.3M 1.2M 0.0k 12.9M 12.2M 0.0k nvme4n15 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.3M 1.2M 0.0k 12.6M 12.1M 0.0k nvme4n16 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 82.90 1.2M 1.3M 0.0k 12.4M 12.7M 0.0k nvme4n17 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.4M 1.3M 0.0k 13.6M 12.7M 0.0k nvme4n18 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.4M 1.3M 0.0k 13.5M 13.1M 0.0k nvme4n19 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 1.4M 1.4M 0.0k 14.1M 13.6M 0.0k nvme4n20 2026-02-18T03:27:03.985 INFO:tasks.workunit.client.1.trial078.stdout: 89.90 1.2M 1.3M 0.0k 12.2M 13.0M 0.0k nvme8n11 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 1.3M 1.3M 0.0k 12.7M 13.2M 0.0k nvme8n12 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 84.40 1.2M 1.3M 0.0k 12.2M 12.8M 0.0k nvme8n13 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 84.80 1.3M 1.2M 0.0k 13.0M 12.1M 0.0k nvme8n14 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1.3M 1.3M 0.0k 13.2M 13.2M 0.0k nvme8n15 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.4M 1.4M 0.0k 13.6M 13.8M 0.0k nvme8n16 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 86.70 1.3M 1.3M 0.0k 12.5M 13.1M 0.0k nvme8n17 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 85.50 1.2M 1.3M 0.0k 11.9M 12.5M 0.0k nvme8n18 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 95.20 1.5M 1.3M 0.0k 14.7M 13.0M 0.0k nvme8n19 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 1.5M 1.3M 0.0k 15.0M 13.2M 0.0k nvme8n20 2026-02-18T03:27:03.986 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:04.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: pgmap v384: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 79 MiB/s rd, 82 MiB/s wr, 5.62k op/s 2026-02-18T03:27:04.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:27:04.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: Adjusting osd_memory_target on trial194 to 85071M 2026-02-18T03:27:04.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:04.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:27:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:27:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:27:04.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:04 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/657274219' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: pgmap v384: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 79 MiB/s rd, 82 MiB/s wr, 5.62k op/s 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: Adjusting osd_memory_target on trial194 to 85071M 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:27:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:04 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/657274219' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: pgmap v384: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 79 MiB/s rd, 82 MiB/s wr, 5.62k op/s 2026-02-18T03:27:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:27:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: Adjusting osd_memory_target on trial194 to 85071M 2026-02-18T03:27:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:27:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:27:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:27:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:27:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:04 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/657274219' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:05.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:05 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/570110911' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:05.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:05 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/943938044' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:05.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:05 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/570110911' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:05.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:05 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/943938044' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:05.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:05 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/570110911' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:05.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:05 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/943938044' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:06.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:06 trial097 ceph-mon[21799]: pgmap v385: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 5.61k op/s 2026-02-18T03:27:06.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:06 trial119 ceph-mon[24143]: pgmap v385: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 5.61k op/s 2026-02-18T03:27:06.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:06 trial114 ceph-mon[23907]: pgmap v385: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 5.61k op/s 2026-02-18T03:27:08.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:08 trial097 ceph-mon[21799]: pgmap v386: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 4.98k op/s 2026-02-18T03:27:08.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:08 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3462548773' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:08.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:08 trial119 ceph-mon[24143]: pgmap v386: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 4.98k op/s 2026-02-18T03:27:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:08 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3462548773' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:08 trial114 ceph-mon[23907]: pgmap v386: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 4.98k op/s 2026-02-18T03:27:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:08 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3462548773' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:10.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:10 trial097 ceph-mon[21799]: pgmap v387: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.11k op/s 2026-02-18T03:27:10.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:10 trial119 ceph-mon[24143]: pgmap v387: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.11k op/s 2026-02-18T03:27:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:10 trial114 ceph-mon[23907]: pgmap v387: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.11k op/s 2026-02-18T03:27:11.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:11 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2141211288' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:11.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:11 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2141211288' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:11.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:11 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2141211288' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:12 trial097 ceph-mon[21799]: pgmap v388: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.61k op/s 2026-02-18T03:27:12.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/556296613' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:12 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3950102824' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:12 trial119 ceph-mon[24143]: pgmap v388: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.61k op/s 2026-02-18T03:27:12.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/556296613' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:12 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3950102824' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:12 trial114 ceph-mon[23907]: pgmap v388: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.61k op/s 2026-02-18T03:27:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/556296613' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:12 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3950102824' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:13.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:13.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 81.50 1.1M 1.2M 0.0k 11.3M 11.6M 0.0k nvme12n1 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 1.3M 1.3M 0.0k 13.1M 13.3M 0.0k nvme12n10 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.3M 1.2M 0.0k 13.0M 12.4M 0.0k nvme12n2 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 1.4M 1.2M 0.0k 13.6M 12.0M 0.0k nvme12n3 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 1.3M 1.3M 0.0k 13.5M 13.1M 0.0k nvme12n4 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.70 1.2M 1.4M 0.0k 12.2M 13.6M 0.0k nvme12n5 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.50 1.2M 1.2M 0.0k 12.5M 11.8M 0.0k nvme12n6 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 97.80 1.4M 1.3M 0.0k 13.6M 13.2M 0.0k nvme12n7 2026-02-18T03:27:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.3M 1.2M 0.0k 13.1M 12.4M 0.0k nvme12n8 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.2M 1.3M 0.0k 12.0M 13.2M 0.0k nvme12n9 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.40 1.3M 1.2M 0.0k 13.4M 11.7M 0.0k nvme4n1 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 83.90 1.3M 1.3M 0.0k 12.6M 12.6M 0.0k nvme4n10 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 1.2M 1.3M 0.0k 12.4M 13.4M 0.0k nvme4n2 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.10 1.3M 1.3M 0.0k 12.9M 13.2M 0.0k nvme4n3 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.3M 1.3M 0.0k 12.9M 13.2M 0.0k nvme4n4 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 1.4M 1.2M 0.0k 14.5M 12.4M 0.0k nvme4n5 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.20 1.2M 1.2M 0.0k 11.6M 12.4M 0.0k nvme4n6 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.3M 1.3M 0.0k 12.8M 12.6M 0.0k nvme4n7 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1.4M 1.3M 0.0k 13.8M 12.5M 0.0k nvme4n8 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.20 1.3M 1.3M 0.0k 12.6M 12.9M 0.0k nvme4n9 2026-02-18T03:27:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 1.2M 1.1M 0.0k 12.2M 11.4M 0.0k nvme8n1 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.4M 1.3M 0.0k 13.8M 12.6M 0.0k nvme8n10 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.3M 1.3M 0.0k 13.4M 13.4M 0.0k nvme8n2 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.2M 1.3M 0.0k 12.0M 13.2M 0.0k nvme8n3 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 84.80 1.2M 1.2M 0.0k 12.4M 12.5M 0.0k nvme8n4 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 1.3M 1.2M 0.0k 12.6M 12.5M 0.0k nvme8n5 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 1.4M 1.3M 0.0k 13.9M 12.9M 0.0k nvme8n6 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 1.2M 1.3M 0.0k 12.5M 13.0M 0.0k nvme8n7 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 95.70 1.3M 1.4M 0.0k 13.3M 14.4M 0.0k nvme8n8 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 97.00 1.3M 1.3M 0.0k 13.3M 13.0M 0.0k nvme8n9 2026-02-18T03:27:13.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:13.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:13.980 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 84.10 1.2M 1.2M 0.0k 11.7M 12.0M 0.0k nvme12n11 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.4M 1.3M 0.0k 14.0M 13.1M 0.0k nvme12n12 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 84.20 1.2M 1.2M 0.0k 12.2M 11.8M 0.0k nvme12n13 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 1.3M 1.3M 0.0k 12.7M 12.9M 0.0k nvme12n14 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.10 1.3M 1.3M 0.0k 13.4M 12.6M 0.0k nvme12n15 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.5M 1.2M 0.0k 14.7M 12.5M 0.0k nvme12n16 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 1.3M 1.3M 0.0k 12.9M 13.3M 0.0k nvme12n17 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.3M 1.3M 0.0k 13.3M 13.0M 0.0k nvme12n18 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 84.60 1.2M 1.3M 0.0k 11.8M 12.8M 0.0k nvme12n19 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.40 1.3M 1.3M 0.0k 12.7M 13.2M 0.0k nvme12n20 2026-02-18T03:27:13.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1.4M 1.2M 0.0k 13.7M 11.8M 0.0k nvme4n11 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.70 1.2M 1.1M 0.0k 12.5M 11.4M 0.0k nvme4n12 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.10 1.1M 1.4M 0.0k 11.4M 14.1M 0.0k nvme4n13 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.3M 1.2M 0.0k 12.6M 12.2M 0.0k nvme4n14 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.4M 1.3M 0.0k 14.2M 13.5M 0.0k nvme4n15 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.3M 1.3M 0.0k 12.9M 13.0M 0.0k nvme4n16 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 81.70 1.2M 1.3M 0.0k 11.6M 13.1M 0.0k nvme4n17 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1.3M 1.2M 0.0k 13.0M 12.4M 0.0k nvme4n18 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 84.80 1.3M 1.2M 0.0k 13.1M 12.3M 0.0k nvme4n19 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.3M 1.4M 0.0k 13.0M 13.6M 0.0k nvme4n20 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 100.40 1.4M 1.3M 0.0k 13.7M 13.3M 0.0k nvme8n11 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.3M 1.3M 0.0k 13.0M 12.9M 0.0k nvme8n12 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 84.90 1.2M 1.3M 0.0k 12.0M 12.5M 0.0k nvme8n13 2026-02-18T03:27:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 83.20 1.2M 1.3M 0.0k 12.0M 12.8M 0.0k nvme8n14 2026-02-18T03:27:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.3M 1.3M 0.0k 13.1M 13.3M 0.0k nvme8n15 2026-02-18T03:27:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.4M 1.4M 0.0k 14.4M 13.9M 0.0k nvme8n16 2026-02-18T03:27:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.4M 1.4M 0.0k 13.8M 13.6M 0.0k nvme8n17 2026-02-18T03:27:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 1.2M 1.3M 0.0k 11.9M 13.2M 0.0k nvme8n18 2026-02-18T03:27:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.3M 1.2M 0.0k 13.0M 12.3M 0.0k nvme8n19 2026-02-18T03:27:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.60 1.4M 1.4M 0.0k 14.0M 13.8M 0.0k nvme8n20 2026-02-18T03:27:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:14.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:14 trial097 ceph-mon[21799]: pgmap v389: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.62k op/s 2026-02-18T03:27:14.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:14 trial119 ceph-mon[24143]: pgmap v389: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.62k op/s 2026-02-18T03:27:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:14 trial114 ceph-mon[23907]: pgmap v389: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.62k op/s 2026-02-18T03:27:15.903 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1648871774' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:15.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:15 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1648871774' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:15.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:15 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1648871774' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:16.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:16 trial097 ceph-mon[21799]: pgmap v390: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 80 MiB/s wr, 5.63k op/s 2026-02-18T03:27:16.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:16 trial119 ceph-mon[24143]: pgmap v390: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 80 MiB/s wr, 5.63k op/s 2026-02-18T03:27:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:16 trial114 ceph-mon[23907]: pgmap v390: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 80 MiB/s wr, 5.63k op/s 2026-02-18T03:27:18.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:18 trial097 ceph-mon[21799]: pgmap v391: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 71 MiB/s wr, 5.01k op/s 2026-02-18T03:27:18.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1248796203' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:18.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:18 trial119 ceph-mon[24143]: pgmap v391: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 71 MiB/s wr, 5.01k op/s 2026-02-18T03:27:18.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1248796203' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:18 trial114 ceph-mon[23907]: pgmap v391: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 71 MiB/s wr, 5.01k op/s 2026-02-18T03:27:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1248796203' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/4065365104' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:19 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1614875275' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/4065365104' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:19 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1614875275' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/4065365104' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:19 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1614875275' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:20.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:20 trial097 ceph-mon[21799]: pgmap v392: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.20k op/s 2026-02-18T03:27:20.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:20 trial119 ceph-mon[24143]: pgmap v392: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.20k op/s 2026-02-18T03:27:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:20 trial114 ceph-mon[23907]: pgmap v392: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.20k op/s 2026-02-18T03:27:22.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:22 trial097 ceph-mon[21799]: pgmap v393: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 81 MiB/s wr, 5.70k op/s 2026-02-18T03:27:22.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:22 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3405573705' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:22.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:22 trial119 ceph-mon[24143]: pgmap v393: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 81 MiB/s wr, 5.70k op/s 2026-02-18T03:27:22.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:22 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3405573705' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:22.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:22 trial114 ceph-mon[23907]: pgmap v393: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 81 MiB/s wr, 5.70k op/s 2026-02-18T03:27:22.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:22 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3405573705' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:23.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:23.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.3M 1.4M 0.0k 12.9M 13.5M 0.0k nvme12n1 2026-02-18T03:27:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 82.30 1.1M 1.2M 0.0k 11.4M 12.3M 0.0k nvme12n10 2026-02-18T03:27:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.2M 1.3M 0.0k 12.1M 13.1M 0.0k nvme12n2 2026-02-18T03:27:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.3M 1.3M 0.0k 13.1M 12.8M 0.0k nvme12n3 2026-02-18T03:27:23.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.2M 1.2M 0.0k 12.4M 12.2M 0.0k nvme12n4 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 82.10 1.2M 1.2M 0.0k 12.0M 12.5M 0.0k nvme12n5 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.60 1.3M 1.3M 0.0k 13.3M 13.3M 0.0k nvme12n6 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.3M 1.3M 0.0k 12.9M 12.5M 0.0k nvme12n7 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.3M 1.3M 0.0k 12.9M 12.5M 0.0k nvme12n8 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.3M 1.2M 0.0k 12.5M 12.3M 0.0k nvme12n9 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.3M 1.2M 0.0k 12.7M 11.8M 0.0k nvme4n1 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.50 1.3M 1.3M 0.0k 13.1M 12.9M 0.0k nvme4n10 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 1.4M 1.2M 0.0k 13.8M 12.0M 0.0k nvme4n2 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.4M 1.3M 0.0k 13.5M 12.6M 0.0k nvme4n3 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.30 1.2M 1.2M 0.0k 12.4M 12.3M 0.0k nvme4n4 2026-02-18T03:27:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.20 1.3M 1.4M 0.0k 13.0M 13.7M 0.0k nvme4n5 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.3M 1.3M 0.0k 13.1M 12.7M 0.0k nvme4n6 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.80 1.3M 1.2M 0.0k 13.0M 12.0M 0.0k nvme4n7 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.40 1.2M 1.2M 0.0k 11.9M 12.0M 0.0k nvme4n8 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1.3M 1.4M 0.0k 13.5M 13.7M 0.0k nvme4n9 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.10 1.2M 1.3M 0.0k 12.5M 12.9M 0.0k nvme8n1 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.2M 1.2M 0.0k 12.5M 12.3M 0.0k nvme8n10 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.3M 1.2M 0.0k 13.1M 12.2M 0.0k nvme8n2 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.3M 1.3M 0.0k 12.8M 13.3M 0.0k nvme8n3 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.3M 1.3M 0.0k 12.7M 12.6M 0.0k nvme8n4 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.40 1.4M 1.3M 0.0k 14.3M 13.2M 0.0k nvme8n5 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 83.90 1.2M 1.3M 0.0k 11.7M 12.9M 0.0k nvme8n6 2026-02-18T03:27:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 1.4M 1.4M 0.0k 13.7M 13.6M 0.0k nvme8n7 2026-02-18T03:27:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.2M 1.3M 0.0k 12.4M 13.5M 0.0k nvme8n8 2026-02-18T03:27:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.3M 1.1M 0.0k 12.8M 11.2M 0.0k nvme8n9 2026-02-18T03:27:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:23.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:23.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:23.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.30 1.2M 1.3M 0.0k 12.5M 13.3M 0.0k nvme12n11 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.3M 1.3M 0.0k 12.9M 12.7M 0.0k nvme12n12 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 1.4M 1.3M 0.0k 13.8M 13.4M 0.0k nvme12n13 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.30 1.2M 1.3M 0.0k 11.5M 12.6M 0.0k nvme12n14 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.10 1.2M 1.3M 0.0k 11.7M 13.3M 0.0k nvme12n15 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 1.3M 1.3M 0.0k 12.7M 13.1M 0.0k nvme12n16 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.3M 1.2M 0.0k 13.0M 12.2M 0.0k nvme12n17 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 84.10 1.1M 1.2M 0.0k 11.1M 12.4M 0.0k nvme12n18 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 1.2M 1.3M 0.0k 12.2M 12.8M 0.0k nvme12n19 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.3M 1.3M 0.0k 12.8M 13.3M 0.0k nvme12n20 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1.3M 1.3M 0.0k 13.1M 13.2M 0.0k nvme4n11 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.2M 1.2M 0.0k 11.7M 12.5M 0.0k nvme4n12 2026-02-18T03:27:23.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.3M 1.4M 0.0k 13.0M 13.5M 0.0k nvme4n13 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.90 1.3M 1.3M 0.0k 13.3M 13.4M 0.0k nvme4n14 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 1.2M 1.3M 0.0k 12.2M 12.9M 0.0k nvme4n15 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 99.20 1.4M 1.4M 0.0k 14.2M 13.6M 0.0k nvme4n16 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.3M 1.3M 0.0k 13.1M 13.1M 0.0k nvme4n17 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 1.4M 1.4M 0.0k 14.2M 13.5M 0.0k nvme4n18 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.90 1.3M 1.3M 0.0k 13.4M 13.4M 0.0k nvme4n19 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.60 1.3M 1.3M 0.0k 13.1M 12.6M 0.0k nvme4n20 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 1.3M 1.2M 0.0k 12.9M 12.3M 0.0k nvme8n11 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.60 1.4M 1.3M 0.0k 13.7M 12.7M 0.0k nvme8n12 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.3M 1.3M 0.0k 13.3M 13.2M 0.0k nvme8n13 2026-02-18T03:27:23.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.00 1.3M 1.3M 0.0k 12.5M 13.5M 0.0k nvme8n14 2026-02-18T03:27:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 95.60 1.5M 1.3M 0.0k 14.6M 12.8M 0.0k nvme8n15 2026-02-18T03:27:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.3M 1.3M 0.0k 12.8M 12.8M 0.0k nvme8n16 2026-02-18T03:27:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.3M 1.2M 0.0k 12.6M 12.0M 0.0k nvme8n17 2026-02-18T03:27:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 82.10 1.1M 1.3M 0.0k 10.5M 12.6M 0.0k nvme8n18 2026-02-18T03:27:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 85.80 1.3M 1.2M 0.0k 12.7M 12.1M 0.0k nvme8n19 2026-02-18T03:27:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 85.90 1.2M 1.2M 0.0k 12.4M 12.1M 0.0k nvme8n20 2026-02-18T03:27:23.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:24.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:24 trial097 ceph-mon[21799]: pgmap v394: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.70k op/s 2026-02-18T03:27:24.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:24 trial119 ceph-mon[24143]: pgmap v394: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.70k op/s 2026-02-18T03:27:24.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:24 trial114 ceph-mon[23907]: pgmap v394: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 5.70k op/s 2026-02-18T03:27:25.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:25 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/600285146' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:25.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:25 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/600285146' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:25.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:25 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/600285146' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:26.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:26 trial097 ceph-mon[21799]: pgmap v395: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 80 MiB/s wr, 5.68k op/s 2026-02-18T03:27:26.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:26 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3309811345' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:26.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:26 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1874778613' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:26.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:26 trial119 ceph-mon[24143]: pgmap v395: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 80 MiB/s wr, 5.68k op/s 2026-02-18T03:27:26.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:26 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3309811345' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:26.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:26 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1874778613' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:26 trial114 ceph-mon[23907]: pgmap v395: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 80 MiB/s wr, 5.68k op/s 2026-02-18T03:27:26.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:26 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3309811345' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:26.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:26 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1874778613' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:28.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:28 trial097 ceph-mon[21799]: pgmap v396: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.03k op/s 2026-02-18T03:27:28.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:28 trial119 ceph-mon[24143]: pgmap v396: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.03k op/s 2026-02-18T03:27:28.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:28 trial114 ceph-mon[23907]: pgmap v396: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.03k op/s 2026-02-18T03:27:29.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:29 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3942879237' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:29.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:29 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3942879237' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:29.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:29 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3942879237' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:30.904 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:30 trial097 ceph-mon[21799]: pgmap v397: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 72 MiB/s wr, 5.17k op/s 2026-02-18T03:27:30.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:30 trial119 ceph-mon[24143]: pgmap v397: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 72 MiB/s wr, 5.17k op/s 2026-02-18T03:27:30.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:30 trial114 ceph-mon[23907]: pgmap v397: 33 pgs: 33 active+clean; 60 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 72 MiB/s wr, 5.17k op/s 2026-02-18T03:27:32.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:32 trial097 ceph-mon[21799]: pgmap v398: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 79 MiB/s wr, 5.63k op/s 2026-02-18T03:27:32.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:32 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/691099053' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:32.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:32 trial119 ceph-mon[24143]: pgmap v398: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 79 MiB/s wr, 5.63k op/s 2026-02-18T03:27:32.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:32 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/691099053' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:32.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:32 trial114 ceph-mon[23907]: pgmap v398: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 79 MiB/s wr, 5.63k op/s 2026-02-18T03:27:32.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:32 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/691099053' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.3M 1.3M 0.0k 13.1M 13.1M 0.0k nvme12n1 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 1.3M 1.2M 0.0k 13.1M 12.1M 0.0k nvme12n10 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.3M 1.2M 0.0k 12.9M 12.1M 0.0k nvme12n2 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 1.2M 1.3M 0.0k 12.0M 12.8M 0.0k nvme12n3 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 1.2M 1.3M 0.0k 12.1M 12.7M 0.0k nvme12n4 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.40 1.3M 1.3M 0.0k 13.1M 12.9M 0.0k nvme12n5 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.00 1.1M 1.2M 0.0k 11.5M 12.2M 0.0k nvme12n6 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.3M 1.2M 0.0k 13.5M 11.6M 0.0k nvme12n7 2026-02-18T03:27:33.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.2M 1.2M 0.0k 12.2M 11.9M 0.0k nvme12n8 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 83.90 1.2M 1.3M 0.0k 11.7M 12.9M 0.0k nvme12n9 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 1.2M 1.3M 0.0k 12.4M 13.3M 0.0k nvme4n1 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.2M 1.3M 0.0k 12.4M 12.5M 0.0k nvme4n10 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.2M 1.2M 0.0k 12.4M 12.2M 0.0k nvme4n2 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 1.3M 1.3M 0.0k 13.0M 12.8M 0.0k nvme4n3 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.3M 1.3M 0.0k 13.4M 12.7M 0.0k nvme4n4 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.2M 1.2M 0.0k 12.5M 12.2M 0.0k nvme4n5 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.3M 1.2M 0.0k 12.6M 12.4M 0.0k nvme4n6 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.2M 1.3M 0.0k 12.3M 13.3M 0.0k nvme4n7 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.20 1.4M 1.3M 0.0k 14.4M 12.8M 0.0k nvme4n8 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 1.3M 1.3M 0.0k 13.4M 13.0M 0.0k nvme4n9 2026-02-18T03:27:33.499 INFO:tasks.workunit.client.0.trial031.stdout: 84.50 1.2M 1.2M 0.0k 11.5M 12.5M 0.0k nvme8n1 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 1.3M 1.3M 0.0k 12.9M 12.5M 0.0k nvme8n10 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.00 1.2M 1.3M 0.0k 11.5M 12.5M 0.0k nvme8n2 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 1.1M 1.2M 0.0k 11.4M 11.7M 0.0k nvme8n3 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 83.80 1.2M 1.1M 0.0k 12.2M 11.3M 0.0k nvme8n4 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.2M 1.3M 0.0k 12.3M 12.6M 0.0k nvme8n5 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 83.90 1.3M 1.2M 0.0k 12.8M 11.8M 0.0k nvme8n6 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.3M 1.2M 0.0k 12.6M 11.7M 0.0k nvme8n7 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.70 1.2M 1.3M 0.0k 11.7M 13.1M 0.0k nvme8n8 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.3M 1.2M 0.0k 13.1M 12.0M 0.0k nvme8n9 2026-02-18T03:27:33.500 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:33.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:33 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3152437327' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:33.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:33 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3334981321' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:33.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:33 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3152437327' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:33.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:33 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3334981321' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:33.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:33 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3152437327' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:33.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:33 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3334981321' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:33.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.70 1.3M 1.3M 0.0k 12.6M 12.6M 0.0k nvme12n11 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.1M 1.2M 0.0k 11.2M 12.3M 0.0k nvme12n12 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.80 1.2M 1.1M 0.0k 12.4M 11.1M 0.0k nvme12n13 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.2M 1.3M 0.0k 11.7M 12.9M 0.0k nvme12n14 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 84.40 1.1M 1.2M 0.0k 11.3M 12.4M 0.0k nvme12n15 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 90.10 1.3M 1.3M 0.0k 12.9M 12.9M 0.0k nvme12n16 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.3M 1.3M 0.0k 12.9M 12.9M 0.0k nvme12n17 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 1.3M 1.2M 0.0k 12.5M 11.6M 0.0k nvme12n18 2026-02-18T03:27:33.981 INFO:tasks.workunit.client.1.trial078.stdout: 83.90 1.2M 1.3M 0.0k 11.9M 12.6M 0.0k nvme12n19 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 1.2M 1.3M 0.0k 12.0M 12.9M 0.0k nvme12n20 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.2M 1.2M 0.0k 12.3M 12.0M 0.0k nvme4n11 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.3M 1.4M 0.0k 13.0M 13.6M 0.0k nvme4n12 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.4M 1.1M 0.0k 13.5M 11.4M 0.0k nvme4n13 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.2M 1.3M 0.0k 11.9M 13.4M 0.0k nvme4n14 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.80 1.4M 1.3M 0.0k 14.0M 12.9M 0.0k nvme4n15 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 1.3M 1.3M 0.0k 12.8M 12.8M 0.0k nvme4n16 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.3M 1.2M 0.0k 13.2M 11.5M 0.0k nvme4n17 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.4M 1.3M 0.0k 14.2M 13.3M 0.0k nvme4n18 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.3M 1.2M 0.0k 13.1M 11.9M 0.0k nvme4n19 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.70 1.3M 1.3M 0.0k 12.9M 13.0M 0.0k nvme4n20 2026-02-18T03:27:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.90 1.2M 1.3M 0.0k 11.9M 12.6M 0.0k nvme8n11 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.30 1.3M 1.3M 0.0k 12.6M 12.8M 0.0k nvme8n12 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 85.80 1.1M 1.3M 0.0k 11.3M 12.8M 0.0k nvme8n13 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.3M 1.2M 0.0k 13.4M 11.7M 0.0k nvme8n14 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 85.70 1.2M 1.2M 0.0k 11.6M 12.4M 0.0k nvme8n15 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.40 1.2M 1.2M 0.0k 12.4M 12.0M 0.0k nvme8n16 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 84.90 1.2M 1.2M 0.0k 11.8M 11.8M 0.0k nvme8n17 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 1.4M 1.3M 0.0k 13.6M 12.8M 0.0k nvme8n18 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.2M 1.3M 0.0k 12.4M 13.3M 0.0k nvme8n19 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.2M 1.2M 0.0k 12.1M 12.3M 0.0k nvme8n20 2026-02-18T03:27:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:34.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:34 trial097 ceph-mon[21799]: pgmap v399: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 79 MiB/s wr, 5.63k op/s 2026-02-18T03:27:34.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:34 trial119 ceph-mon[24143]: pgmap v399: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 79 MiB/s wr, 5.63k op/s 2026-02-18T03:27:34.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:34 trial114 ceph-mon[23907]: pgmap v399: 33 pgs: 33 active+clean; 60 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 79 MiB/s wr, 5.63k op/s 2026-02-18T03:27:36.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:36 trial097 ceph-mon[21799]: pgmap v400: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.62k op/s 2026-02-18T03:27:36.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:36 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1017784530' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:36.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:36 trial119 ceph-mon[24143]: pgmap v400: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.62k op/s 2026-02-18T03:27:36.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:36 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1017784530' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:36 trial114 ceph-mon[23907]: pgmap v400: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.62k op/s 2026-02-18T03:27:36.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:36 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1017784530' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:38.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:38 trial097 ceph-mon[21799]: pgmap v401: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 70 MiB/s wr, 5.00k op/s 2026-02-18T03:27:38.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:38 trial119 ceph-mon[24143]: pgmap v401: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 70 MiB/s wr, 5.00k op/s 2026-02-18T03:27:38.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:38 trial114 ceph-mon[23907]: pgmap v401: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 70 MiB/s wr, 5.00k op/s 2026-02-18T03:27:39.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:39 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3936393163' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:39.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:39 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3936393163' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:39.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:39 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3936393163' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:40.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:40 trial097 ceph-mon[21799]: pgmap v402: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 71 MiB/s wr, 5.15k op/s 2026-02-18T03:27:40.905 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3011590397' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:40.906 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:40 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2536504818' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:40.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:40 trial119 ceph-mon[24143]: pgmap v402: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 71 MiB/s wr, 5.15k op/s 2026-02-18T03:27:40.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3011590397' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:40.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:40 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2536504818' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:40.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:40 trial114 ceph-mon[23907]: pgmap v402: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 71 MiB/s wr, 5.15k op/s 2026-02-18T03:27:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3011590397' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:40.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:40 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2536504818' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:42.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:42 trial119 ceph-mon[24143]: pgmap v403: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.65k op/s 2026-02-18T03:27:42.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:42 trial114 ceph-mon[23907]: pgmap v403: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.65k op/s 2026-02-18T03:27:43.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:42 trial097 ceph-mon[21799]: pgmap v403: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.65k op/s 2026-02-18T03:27:43.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:43.499 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 82.20 1.1M 1.2M 0.0k 11.4M 12.4M 0.0k nvme12n1 2026-02-18T03:27:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.2M 1.3M 0.0k 12.0M 13.2M 0.0k nvme12n10 2026-02-18T03:27:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.60 1.2M 1.2M 0.0k 12.3M 12.1M 0.0k nvme12n2 2026-02-18T03:27:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.50 1.3M 1.2M 0.0k 13.3M 12.2M 0.0k nvme12n3 2026-02-18T03:27:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 82.00 1.1M 1.2M 0.0k 10.7M 11.5M 0.0k nvme12n4 2026-02-18T03:27:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 85.10 1.2M 1.3M 0.0k 11.9M 12.9M 0.0k nvme12n5 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.40 1.1M 1.2M 0.0k 10.8M 11.9M 0.0k nvme12n6 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.2M 1.2M 0.0k 12.1M 11.6M 0.0k nvme12n7 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.3M 1.3M 0.0k 12.8M 13.2M 0.0k nvme12n8 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 94.30 1.3M 1.3M 0.0k 13.0M 12.5M 0.0k nvme12n9 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.40 1.2M 1.2M 0.0k 12.3M 11.9M 0.0k nvme4n1 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.3M 1.2M 0.0k 12.6M 11.7M 0.0k nvme4n10 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 1.2M 1.2M 0.0k 12.3M 12.2M 0.0k nvme4n2 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.1M 1.3M 0.0k 11.2M 13.1M 0.0k nvme4n3 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.1M 1.3M 0.0k 11.3M 13.2M 0.0k nvme4n4 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.00 1.3M 1.3M 0.0k 13.4M 12.5M 0.0k nvme4n5 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.3M 1.3M 0.0k 13.1M 12.7M 0.0k nvme4n6 2026-02-18T03:27:43.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.3M 1.2M 0.0k 12.9M 12.4M 0.0k nvme4n7 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.30 1.2M 1.3M 0.0k 12.0M 12.9M 0.0k nvme4n8 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.80 1.2M 1.2M 0.0k 12.3M 11.8M 0.0k nvme4n9 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.2M 1.2M 0.0k 12.2M 11.7M 0.0k nvme8n1 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.90 1.3M 1.1M 0.0k 12.8M 11.2M 0.0k nvme8n10 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.3M 1.2M 0.0k 12.7M 11.8M 0.0k nvme8n2 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.3M 1.3M 0.0k 12.7M 12.6M 0.0k nvme8n3 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.30 1.3M 1.3M 0.0k 12.7M 12.9M 0.0k nvme8n4 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.2M 1.3M 0.0k 12.5M 13.5M 0.0k nvme8n5 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 1.1M 1.3M 0.0k 11.5M 12.8M 0.0k nvme8n6 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 83.70 1.2M 1.2M 0.0k 11.6M 11.7M 0.0k nvme8n7 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.2M 1.3M 0.0k 11.9M 13.2M 0.0k nvme8n8 2026-02-18T03:27:43.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.40 1.2M 1.3M 0.0k 12.2M 13.5M 0.0k nvme8n9 2026-02-18T03:27:43.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:43.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:43 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/969206476' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:43.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:43 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/969206476' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:43.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 81.80 1.1M 1.2M 0.0k 11.4M 12.1M 0.0k nvme12n11 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 96.80 1.4M 1.3M 0.0k 13.7M 13.1M 0.0k nvme12n12 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 1.2M 1.3M 0.0k 12.4M 12.9M 0.0k nvme12n13 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.20 1.3M 1.2M 0.0k 12.6M 12.3M 0.0k nvme12n14 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.2M 1.3M 0.0k 11.6M 13.1M 0.0k nvme12n15 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.80 1.1M 1.2M 0.0k 11.3M 11.9M 0.0k nvme12n16 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.60 1.2M 1.2M 0.0k 12.5M 11.7M 0.0k nvme12n17 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.3M 1.2M 0.0k 12.9M 11.8M 0.0k nvme12n18 2026-02-18T03:27:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 85.00 1.2M 1.1M 0.0k 11.7M 11.0M 0.0k nvme12n19 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1.3M 1.2M 0.0k 12.7M 11.9M 0.0k nvme12n20 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.40 1.1M 1.3M 0.0k 10.9M 12.8M 0.0k nvme4n11 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 1.3M 1.2M 0.0k 13.3M 12.4M 0.0k nvme4n12 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 1.3M 1.3M 0.0k 12.8M 12.6M 0.0k nvme4n13 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 1.3M 1.3M 0.0k 12.7M 12.7M 0.0k nvme4n14 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.3M 1.2M 0.0k 13.0M 12.1M 0.0k nvme4n15 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.3M 1.2M 0.0k 13.1M 12.3M 0.0k nvme4n16 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.2M 1.3M 0.0k 11.6M 12.9M 0.0k nvme4n17 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 1.3M 1.4M 0.0k 13.3M 13.8M 0.0k nvme4n18 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.70 1.1M 1.3M 0.0k 11.0M 12.5M 0.0k nvme4n19 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.60 1.2M 1.2M 0.0k 12.3M 12.3M 0.0k nvme4n20 2026-02-18T03:27:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.80 1.2M 1.2M 0.0k 12.1M 12.4M 0.0k nvme8n11 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 96.70 1.3M 1.3M 0.0k 12.9M 12.8M 0.0k nvme8n12 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.00 1.2M 1.2M 0.0k 12.3M 12.0M 0.0k nvme8n13 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 1.2M 1.3M 0.0k 12.1M 12.5M 0.0k nvme8n14 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 1.3M 1.2M 0.0k 13.0M 12.2M 0.0k nvme8n15 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.90 1.3M 1.3M 0.0k 13.1M 13.4M 0.0k nvme8n16 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.3M 1.2M 0.0k 12.6M 12.4M 0.0k nvme8n17 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.4M 1.2M 0.0k 13.9M 11.7M 0.0k nvme8n18 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1.2M 1.2M 0.0k 12.2M 12.2M 0.0k nvme8n19 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1.2M 1.2M 0.0k 12.0M 11.9M 0.0k nvme8n20 2026-02-18T03:27:43.983 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:44.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:43 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/969206476' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:44 trial119 ceph-mon[24143]: pgmap v404: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.67k op/s 2026-02-18T03:27:44.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:44 trial114 ceph-mon[23907]: pgmap v404: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.67k op/s 2026-02-18T03:27:45.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:44 trial097 ceph-mon[21799]: pgmap v404: 33 pgs: 33 active+clean; 60 GiB data, 106 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.67k op/s 2026-02-18T03:27:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:46 trial119 ceph-mon[24143]: pgmap v405: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.67k op/s 2026-02-18T03:27:46.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/473618974' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:46.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:46 trial114 ceph-mon[23907]: pgmap v405: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.67k op/s 2026-02-18T03:27:46.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/473618974' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:47.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:46 trial097 ceph-mon[21799]: pgmap v405: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 75 MiB/s rd, 78 MiB/s wr, 5.67k op/s 2026-02-18T03:27:47.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/473618974' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:47.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:47 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1280378697' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:47.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:47 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/4030760317' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:47.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:47 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1280378697' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:47.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:47 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/4030760317' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:48.155 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:47 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1280378697' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:48.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:47 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/4030760317' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:48.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:48 trial119 ceph-mon[24143]: pgmap v406: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 69 MiB/s wr, 5.03k op/s 2026-02-18T03:27:48.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:48 trial114 ceph-mon[23907]: pgmap v406: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 69 MiB/s wr, 5.03k op/s 2026-02-18T03:27:49.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:48 trial097 ceph-mon[21799]: pgmap v406: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 66 MiB/s rd, 69 MiB/s wr, 5.03k op/s 2026-02-18T03:27:50.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:50 trial119 ceph-mon[24143]: pgmap v407: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.17k op/s 2026-02-18T03:27:50.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:50 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/196365590' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:50.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:50 trial114 ceph-mon[23907]: pgmap v407: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.17k op/s 2026-02-18T03:27:50.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:50 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/196365590' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:50 trial097 ceph-mon[21799]: pgmap v407: 33 pgs: 33 active+clean; 60 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 71 MiB/s wr, 5.17k op/s 2026-02-18T03:27:51.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:50 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/196365590' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:52.957 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:52 trial097 ceph-mon[21799]: pgmap v408: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 77 MiB/s wr, 5.65k op/s 2026-02-18T03:27:52.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:52 trial119 ceph-mon[24143]: pgmap v408: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 77 MiB/s wr, 5.65k op/s 2026-02-18T03:27:52.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:52 trial114 ceph-mon[23907]: pgmap v408: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 74 MiB/s rd, 77 MiB/s wr, 5.65k op/s 2026-02-18T03:27:53.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:53.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 79.30 1023.6k 1.1M 0.0k 10.0M 11.3M 0.0k nvme12n1 2026-02-18T03:27:53.498 INFO:tasks.workunit.client.0.trial031.stdout: 82.50 1.1M 1.2M 0.0k 11.3M 12.0M 0.0k nvme12n10 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 95.60 1.4M 1.2M 0.0k 13.6M 12.1M 0.0k nvme12n2 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.4M 1.2M 0.0k 13.6M 12.4M 0.0k nvme12n3 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 86.30 1.1M 1.3M 0.0k 11.4M 12.6M 0.0k nvme12n4 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 80.80 1.0M 1.2M 0.0k 10.4M 11.9M 0.0k nvme12n5 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.2M 1.2M 0.0k 12.0M 11.6M 0.0k nvme12n6 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 1.2M 1.4M 0.0k 12.0M 13.5M 0.0k nvme12n7 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.20 1.1M 1.2M 0.0k 11.4M 11.8M 0.0k nvme12n8 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.3M 1.1M 0.0k 12.6M 11.1M 0.0k nvme12n9 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 80.20 1005.6k 1.2M 0.0k 9.8M 12.5M 0.0k nvme4n1 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 1.4M 1.2M 0.0k 13.8M 11.9M 0.0k nvme4n10 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 82.30 1.1M 1.2M 0.0k 11.0M 11.7M 0.0k nvme4n2 2026-02-18T03:27:53.499 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.2M 1.3M 0.0k 12.3M 12.8M 0.0k nvme4n3 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.2M 1.3M 0.0k 12.1M 12.8M 0.0k nvme4n4 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.30 1.3M 1.3M 0.0k 12.7M 12.5M 0.0k nvme4n5 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.30 1.1M 1.1M 0.0k 11.3M 11.4M 0.0k nvme4n6 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.60 1.2M 1.3M 0.0k 11.7M 12.8M 0.0k nvme4n7 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.90 1.3M 1.2M 0.0k 13.2M 12.0M 0.0k nvme4n8 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 1.2M 1.2M 0.0k 11.8M 11.9M 0.0k nvme4n9 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 1.2M 1.2M 0.0k 11.9M 11.7M 0.0k nvme8n1 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.3M 1.3M 0.0k 12.7M 12.6M 0.0k nvme8n10 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.3M 1.2M 0.0k 12.8M 12.0M 0.0k nvme8n2 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.3M 1.2M 0.0k 13.1M 11.8M 0.0k nvme8n3 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.2M 1.2M 0.0k 11.7M 12.4M 0.0k nvme8n4 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 96.10 1.4M 1.2M 0.0k 13.9M 12.4M 0.0k nvme8n5 2026-02-18T03:27:53.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.3M 1.2M 0.0k 12.9M 11.7M 0.0k nvme8n6 2026-02-18T03:27:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.2M 1.2M 0.0k 12.5M 12.3M 0.0k nvme8n7 2026-02-18T03:27:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.00 1.2M 1.2M 0.0k 12.0M 11.5M 0.0k nvme8n8 2026-02-18T03:27:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.60 1.3M 1.2M 0.0k 13.1M 12.5M 0.0k nvme8n9 2026-02-18T03:27:53.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:27:53.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3105026528' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:53.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3105026528' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:53.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:53.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 84.10 1.1M 1.2M 0.0k 10.6M 12.1M 0.0k nvme12n11 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 1.3M 1.2M 0.0k 13.2M 12.4M 0.0k nvme12n12 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.2M 1.1M 0.0k 12.3M 11.4M 0.0k nvme12n13 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.1M 1.2M 0.0k 11.5M 11.6M 0.0k nvme12n14 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 83.50 1.2M 1.2M 0.0k 12.3M 11.9M 0.0k nvme12n15 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.1M 1.3M 0.0k 11.5M 12.5M 0.0k nvme12n16 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.3M 1.2M 0.0k 13.3M 11.7M 0.0k nvme12n17 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 81.90 1.2M 1.1M 0.0k 11.8M 11.4M 0.0k nvme12n18 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 1.3M 1.2M 0.0k 12.9M 11.9M 0.0k nvme12n19 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 1.2M 1.2M 0.0k 11.7M 12.2M 0.0k nvme12n20 2026-02-18T03:27:53.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.40 1.1M 1.3M 0.0k 11.1M 12.8M 0.0k nvme4n11 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.60 1.1M 1.2M 0.0k 11.2M 12.3M 0.0k nvme4n12 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.00 1.2M 1.2M 0.0k 12.5M 11.7M 0.0k nvme4n13 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.50 1.3M 1.1M 0.0k 13.3M 11.5M 0.0k nvme4n14 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 1.3M 1.2M 0.0k 12.6M 11.7M 0.0k nvme4n15 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 93.20 1.2M 1.3M 0.0k 12.3M 13.1M 0.0k nvme4n16 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 83.10 1.2M 1.2M 0.0k 11.7M 11.5M 0.0k nvme4n17 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.2M 1.2M 0.0k 12.0M 11.8M 0.0k nvme4n18 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 84.80 1.2M 1.2M 0.0k 11.7M 11.8M 0.0k nvme4n19 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 82.30 1.2M 1.1M 0.0k 11.7M 11.1M 0.0k nvme4n20 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.00 1.2M 1.3M 0.0k 12.0M 13.0M 0.0k nvme8n11 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 99.00 1.3M 1.2M 0.0k 12.9M 11.9M 0.0k nvme8n12 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 1.1M 1.2M 0.0k 11.2M 12.0M 0.0k nvme8n13 2026-02-18T03:27:53.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.30 1.1M 1.2M 0.0k 11.5M 12.2M 0.0k nvme8n14 2026-02-18T03:27:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.4M 1.3M 0.0k 13.8M 12.9M 0.0k nvme8n15 2026-02-18T03:27:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.70 1.2M 1.2M 0.0k 12.0M 12.0M 0.0k nvme8n16 2026-02-18T03:27:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 92.10 1.3M 1.2M 0.0k 12.6M 12.2M 0.0k nvme8n17 2026-02-18T03:27:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.1M 1.3M 0.0k 11.1M 13.1M 0.0k nvme8n18 2026-02-18T03:27:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.3M 1.2M 0.0k 12.9M 12.0M 0.0k nvme8n19 2026-02-18T03:27:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 89.50 1.3M 1.2M 0.0k 12.9M 11.7M 0.0k nvme8n20 2026-02-18T03:27:53.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:27:54.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3105026528' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:54 trial119 ceph-mon[24143]: pgmap v409: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 68 MiB/s wr, 5.00k op/s 2026-02-18T03:27:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:54 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3418184279' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:54.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:54 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2371431102' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:54.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:54 trial114 ceph-mon[23907]: pgmap v409: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 68 MiB/s wr, 5.00k op/s 2026-02-18T03:27:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:54 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3418184279' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:54.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:54 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2371431102' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:55.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:54 trial097 ceph-mon[21799]: pgmap v409: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 68 MiB/s wr, 5.00k op/s 2026-02-18T03:27:55.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:54 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3418184279' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:55.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:54 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2371431102' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:56 trial119 ceph-mon[24143]: pgmap v410: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.65k op/s 2026-02-18T03:27:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:56 trial114 ceph-mon[23907]: pgmap v410: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.65k op/s 2026-02-18T03:27:57.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:56 trial097 ceph-mon[21799]: pgmap v410: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.65k op/s 2026-02-18T03:27:57.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:57 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/4215007837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:57.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:57 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/4215007837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:58.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:57 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/4215007837' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:58.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:27:58 trial119 ceph-mon[24143]: pgmap v411: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 67 MiB/s wr, 5.00k op/s 2026-02-18T03:27:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:27:58 trial114 ceph-mon[23907]: pgmap v411: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 67 MiB/s wr, 5.00k op/s 2026-02-18T03:27:59.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:27:58 trial097 ceph-mon[21799]: pgmap v411: 33 pgs: 33 active+clean; 60 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 67 MiB/s wr, 5.00k op/s 2026-02-18T03:28:00.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:00 trial119 ceph-mon[24143]: pgmap v412: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 67 MiB/s rd, 69 MiB/s wr, 5.14k op/s 2026-02-18T03:28:00.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:00 trial114 ceph-mon[23907]: pgmap v412: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 67 MiB/s rd, 69 MiB/s wr, 5.14k op/s 2026-02-18T03:28:01.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:00 trial097 ceph-mon[21799]: pgmap v412: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 67 MiB/s rd, 69 MiB/s wr, 5.14k op/s 2026-02-18T03:28:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:01 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2249030449' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:01 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2501651747' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:01.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:01 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1810991077' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:01.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:01 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2249030449' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:01 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2501651747' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:01.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:01 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1810991077' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:02.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2249030449' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:02.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2501651747' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:02.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:01 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1810991077' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:02.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:02 trial119 ceph-mon[24143]: pgmap v413: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.64k op/s 2026-02-18T03:28:02.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:02 trial114 ceph-mon[23907]: pgmap v413: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.64k op/s 2026-02-18T03:28:03.156 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:02 trial097 ceph-mon[21799]: pgmap v413: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 73 MiB/s rd, 76 MiB/s wr, 5.64k op/s 2026-02-18T03:28:03.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:03.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.2M 1.2M 0.0k 11.8M 12.5M 0.0k nvme12n1 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.30 1.2M 1.1M 0.0k 11.6M 11.0M 0.0k nvme12n10 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.1M 1.2M 0.0k 11.4M 11.9M 0.0k nvme12n2 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.3M 1.1M 0.0k 12.7M 11.3M 0.0k nvme12n3 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.50 1.3M 1.2M 0.0k 12.9M 12.4M 0.0k nvme12n4 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 81.00 1.1M 1.2M 0.0k 11.0M 12.1M 0.0k nvme12n5 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 84.10 1.1M 1.2M 0.0k 10.6M 11.8M 0.0k nvme12n6 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 93.50 1.2M 1.2M 0.0k 12.1M 12.4M 0.0k nvme12n7 2026-02-18T03:28:03.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.1M 1.2M 0.0k 11.3M 12.3M 0.0k nvme12n8 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 84.90 1.1M 1.2M 0.0k 11.0M 12.2M 0.0k nvme12n9 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.2M 1.2M 0.0k 11.8M 12.4M 0.0k nvme4n1 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.2M 1.2M 0.0k 11.9M 12.1M 0.0k nvme4n10 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.3M 1.2M 0.0k 12.9M 11.6M 0.0k nvme4n2 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 94.70 1.2M 1.1M 0.0k 12.3M 11.3M 0.0k nvme4n3 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.10 1.3M 1.1M 0.0k 12.8M 11.2M 0.0k nvme4n4 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.2M 1.2M 0.0k 12.5M 12.1M 0.0k nvme4n5 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 1.3M 1.2M 0.0k 12.7M 12.0M 0.0k nvme4n6 2026-02-18T03:28:03.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.3M 1.2M 0.0k 12.5M 12.0M 0.0k nvme4n7 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 84.30 1.2M 1.2M 0.0k 11.6M 12.4M 0.0k nvme4n8 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 81.00 1.1M 1.2M 0.0k 11.0M 12.0M 0.0k nvme4n9 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.2M 1.1M 0.0k 11.6M 11.1M 0.0k nvme8n1 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.1M 1.2M 0.0k 11.3M 12.0M 0.0k nvme8n10 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.2M 1.2M 0.0k 11.7M 12.4M 0.0k nvme8n2 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 93.20 1.2M 1.3M 0.0k 11.9M 12.5M 0.0k nvme8n3 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.2M 1.2M 0.0k 12.1M 12.1M 0.0k nvme8n4 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.3M 1.3M 0.0k 13.1M 12.6M 0.0k nvme8n5 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 87.80 1.1M 1.2M 0.0k 11.5M 12.5M 0.0k nvme8n6 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 89.20 1.2M 1.2M 0.0k 12.2M 12.0M 0.0k nvme8n7 2026-02-18T03:28:03.503 INFO:tasks.workunit.client.0.trial031.stdout: 91.80 1.3M 1.2M 0.0k 13.5M 11.7M 0.0k nvme8n8 2026-02-18T03:28:03.504 INFO:tasks.workunit.client.0.trial031.stdout: 96.00 1.3M 1.2M 0.0k 12.8M 12.4M 0.0k nvme8n9 2026-02-18T03:28:03.504 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:03.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:03.981 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.30 1.1M 1.2M 0.0k 11.5M 12.0M 0.0k nvme12n11 2026-02-18T03:28:03.981 INFO:tasks.workunit.client.1.trial078.stdout: 87.30 1.2M 1.2M 0.0k 12.1M 12.0M 0.0k nvme12n12 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.10 1.3M 1.2M 0.0k 13.0M 12.4M 0.0k nvme12n13 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.2M 1.3M 0.0k 12.5M 12.6M 0.0k nvme12n14 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.40 1.2M 1.1M 0.0k 12.4M 11.2M 0.0k nvme12n15 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 1.2M 1.1M 0.0k 12.0M 11.3M 0.0k nvme12n16 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.2M 1.1M 0.0k 11.7M 11.1M 0.0k nvme12n17 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.90 1.2M 1.3M 0.0k 11.9M 12.9M 0.0k nvme12n18 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 81.90 1.1M 1.2M 0.0k 10.7M 11.7M 0.0k nvme12n19 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 96.20 1.2M 1.2M 0.0k 12.0M 12.1M 0.0k nvme12n20 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 1.2M 1.2M 0.0k 12.4M 11.8M 0.0k nvme4n11 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.2M 1.2M 0.0k 12.0M 12.2M 0.0k nvme4n12 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.2M 1.2M 0.0k 11.8M 11.8M 0.0k nvme4n13 2026-02-18T03:28:03.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.80 1.2M 1.2M 0.0k 11.8M 11.8M 0.0k nvme4n14 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.90 1.2M 1.2M 0.0k 11.5M 12.0M 0.0k nvme4n15 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.2M 1.2M 0.0k 12.1M 11.9M 0.0k nvme4n16 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 77.00 1019.6k 1.2M 0.0k 10.0M 11.6M 0.0k nvme4n17 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 94.50 1.2M 1.2M 0.0k 12.3M 12.2M 0.0k nvme4n18 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.2M 1.2M 0.0k 12.0M 12.1M 0.0k nvme4n19 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 1.2M 1.1M 0.0k 12.3M 11.2M 0.0k nvme4n20 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.00 1.2M 1.2M 0.0k 11.9M 12.0M 0.0k nvme8n11 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 83.80 1009.6k 1.1M 0.0k 9.9M 11.3M 0.0k nvme8n12 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 1.2M 1.2M 0.0k 12.5M 12.1M 0.0k nvme8n13 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 83.40 1.2M 1.1M 0.0k 11.8M 10.8M 0.0k nvme8n14 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.2M 1.2M 0.0k 12.0M 12.3M 0.0k nvme8n15 2026-02-18T03:28:03.983 INFO:tasks.workunit.client.1.trial078.stdout: 85.20 1.1M 1.2M 0.0k 11.2M 12.4M 0.0k nvme8n16 2026-02-18T03:28:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.50 1.2M 1.2M 0.0k 11.6M 12.4M 0.0k nvme8n17 2026-02-18T03:28:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 1.1M 1.2M 0.0k 11.1M 11.6M 0.0k nvme8n18 2026-02-18T03:28:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 89.60 1.2M 1.1M 0.0k 12.4M 11.4M 0.0k nvme8n19 2026-02-18T03:28:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 84.90 1.2M 1.1M 0.0k 12.4M 11.2M 0.0k nvme8n20 2026-02-18T03:28:03.984 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:04 trial119 ceph-mon[24143]: pgmap v414: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 64 MiB/s rd, 67 MiB/s wr, 5.00k op/s 2026-02-18T03:28:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:28:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:04 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3445359594' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:28:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:28:04.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:28:04.965 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:04 trial119 ceph-mon[24143]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:28:04.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:04 trial114 ceph-mon[23907]: pgmap v414: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 64 MiB/s rd, 67 MiB/s wr, 5.00k op/s 2026-02-18T03:28:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:28:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:04 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3445359594' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:28:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:28:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:28:04.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:04 trial114 ceph-mon[23907]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:28:05.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:04 trial097 ceph-mon[21799]: pgmap v414: 33 pgs: 33 active+clean; 60 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 64 MiB/s rd, 67 MiB/s wr, 5.00k op/s 2026-02-18T03:28:05.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:28:05.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:04 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3445359594' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:05.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:28:05.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:28:05.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' 2026-02-18T03:28:05.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:04 trial097 ceph-mon[21799]: from='mgr.14152 10.20.193.97:0/2645960356' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:28:06.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:06 trial119 ceph-mon[24143]: pgmap v415: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 84 MiB/s wr, 6.26k op/s 2026-02-18T03:28:06.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:06 trial114 ceph-mon[23907]: pgmap v415: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 84 MiB/s wr, 6.26k op/s 2026-02-18T03:28:07.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:06 trial097 ceph-mon[21799]: pgmap v415: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 80 MiB/s rd, 84 MiB/s wr, 6.26k op/s 2026-02-18T03:28:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:08 trial119 ceph-mon[24143]: pgmap v416: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 4.94k op/s 2026-02-18T03:28:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:08 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1040471320' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:08 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/382762033' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:08.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:08 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3910315603' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:08.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:08 trial114 ceph-mon[23907]: pgmap v416: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 4.94k op/s 2026-02-18T03:28:08.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:08 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1040471320' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:08.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:08 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/382762033' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:08.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:08 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3910315603' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:09.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:08 trial097 ceph-mon[21799]: pgmap v416: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 4.94k op/s 2026-02-18T03:28:09.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:08 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1040471320' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:09.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:08 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/382762033' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:09.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:08 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3910315603' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:10.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:10 trial119 ceph-mon[24143]: pgmap v417: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 68 MiB/s wr, 5.10k op/s 2026-02-18T03:28:10.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:10 trial114 ceph-mon[23907]: pgmap v417: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 68 MiB/s wr, 5.10k op/s 2026-02-18T03:28:11.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:10 trial097 ceph-mon[21799]: pgmap v417: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 65 MiB/s rd, 68 MiB/s wr, 5.10k op/s 2026-02-18T03:28:11.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:11 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/4145768370' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:11.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:11 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/4145768370' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:12.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:11 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/4145768370' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:12.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:12 trial119 ceph-mon[24143]: pgmap v418: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.58k op/s 2026-02-18T03:28:12.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:12 trial114 ceph-mon[23907]: pgmap v418: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.58k op/s 2026-02-18T03:28:13.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:12 trial097 ceph-mon[21799]: pgmap v418: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 74 MiB/s wr, 5.58k op/s 2026-02-18T03:28:13.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:13.498 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.10 1.2M 1.1M 0.0k 11.7M 11.0M 0.0k nvme12n1 2026-02-18T03:28:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.80 1.1M 1.2M 0.0k 11.2M 12.1M 0.0k nvme12n10 2026-02-18T03:28:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.60 1.1M 1.2M 0.0k 10.6M 11.6M 0.0k nvme12n2 2026-02-18T03:28:13.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.1M 1.3M 0.0k 11.1M 12.9M 0.0k nvme12n3 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.1M 1.1M 0.0k 11.2M 11.4M 0.0k nvme12n4 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 84.30 1.2M 1.2M 0.0k 12.1M 12.0M 0.0k nvme12n5 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.60 1.2M 1.2M 0.0k 11.8M 12.1M 0.0k nvme12n6 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 96.00 1.1M 1.2M 0.0k 11.4M 11.7M 0.0k nvme12n7 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 83.30 1.1M 1.0M 0.0k 10.6M 10.5M 0.0k nvme12n8 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 83.30 1.0M 1.2M 0.0k 10.5M 12.1M 0.0k nvme12n9 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.2M 1.2M 0.0k 12.0M 11.9M 0.0k nvme4n1 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 82.00 1.1M 1.2M 0.0k 10.8M 11.7M 0.0k nvme4n10 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 84.50 1.1M 1.2M 0.0k 11.4M 11.9M 0.0k nvme4n2 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 88.90 1.2M 1.2M 0.0k 11.6M 12.0M 0.0k nvme4n3 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.2M 1.1M 0.0k 11.9M 10.5M 0.0k nvme4n4 2026-02-18T03:28:13.499 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.2M 1.2M 0.0k 12.3M 12.2M 0.0k nvme4n5 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.2M 1.2M 0.0k 12.2M 12.2M 0.0k nvme4n6 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 90.60 1.3M 1.2M 0.0k 12.6M 11.9M 0.0k nvme4n7 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 86.60 1.1M 1.1M 0.0k 11.5M 11.2M 0.0k nvme4n8 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.90 1.1M 1.2M 0.0k 11.5M 11.5M 0.0k nvme4n9 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 1.1M 1.2M 0.0k 10.9M 11.7M 0.0k nvme8n1 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.60 1.0M 1.2M 0.0k 10.3M 12.2M 0.0k nvme8n10 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 1.3M 1.1M 0.0k 13.2M 11.2M 0.0k nvme8n2 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.60 1.2M 1.2M 0.0k 11.7M 11.9M 0.0k nvme8n3 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 82.50 1.1M 1.1M 0.0k 11.2M 11.0M 0.0k nvme8n4 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.2M 1.3M 0.0k 12.5M 12.8M 0.0k nvme8n5 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.2M 1.2M 0.0k 12.3M 11.8M 0.0k nvme8n6 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.2M 1.2M 0.0k 11.8M 12.2M 0.0k nvme8n7 2026-02-18T03:28:13.500 INFO:tasks.workunit.client.0.trial031.stdout: 85.10 1.1M 1.2M 0.0k 10.5M 12.1M 0.0k nvme8n8 2026-02-18T03:28:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 96.30 1.2M 1.2M 0.0k 12.2M 12.0M 0.0k nvme8n9 2026-02-18T03:28:13.501 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:13.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:13.982 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 86.70 1.2M 1.1M 0.0k 11.7M 11.1M 0.0k nvme12n11 2026-02-18T03:28:13.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 1.2M 1.2M 0.0k 11.9M 11.6M 0.0k nvme12n12 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 81.70 1.0M 1.1M 0.0k 10.2M 10.8M 0.0k nvme12n13 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.80 1008.8k 1.2M 0.0k 9.9M 12.3M 0.0k nvme12n14 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1.2M 1.1M 0.0k 11.8M 10.8M 0.0k nvme12n15 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 82.30 1.0M 1.2M 0.0k 10.0M 11.7M 0.0k nvme12n16 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.50 1.1M 1.3M 0.0k 11.4M 12.9M 0.0k nvme12n17 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 84.50 1.1M 1.1M 0.0k 11.0M 11.0M 0.0k nvme12n18 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 87.70 1.1M 1.2M 0.0k 11.4M 12.4M 0.0k nvme12n19 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.1M 1.2M 0.0k 10.8M 11.7M 0.0k nvme12n20 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.10 1.2M 1.2M 0.0k 11.6M 11.7M 0.0k nvme4n11 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.1M 1.1M 0.0k 11.5M 11.1M 0.0k nvme4n12 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 82.60 1.1M 1.2M 0.0k 11.0M 11.8M 0.0k nvme4n13 2026-02-18T03:28:13.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.40 1.2M 1.1M 0.0k 11.8M 10.8M 0.0k nvme4n14 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.2M 1.1M 0.0k 11.5M 11.4M 0.0k nvme4n15 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.2M 1.1M 0.0k 11.8M 11.1M 0.0k nvme4n16 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 84.40 1.2M 1.2M 0.0k 12.2M 11.8M 0.0k nvme4n17 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.2M 1.2M 0.0k 11.7M 11.8M 0.0k nvme4n18 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 87.50 1.1M 1.2M 0.0k 11.4M 12.1M 0.0k nvme4n19 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 86.00 1.2M 1.1M 0.0k 12.4M 11.3M 0.0k nvme4n20 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 97.30 1.3M 1.2M 0.0k 12.9M 11.7M 0.0k nvme8n11 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 91.50 1.3M 1.0M 0.0k 12.5M 10.3M 0.0k nvme8n12 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 82.50 1.2M 1.1M 0.0k 11.7M 10.7M 0.0k nvme8n13 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 85.40 1.1M 1.2M 0.0k 11.5M 11.8M 0.0k nvme8n14 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.20 1.2M 1.3M 0.0k 12.1M 13.3M 0.0k nvme8n15 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.10 1.2M 1.2M 0.0k 11.8M 11.6M 0.0k nvme8n16 2026-02-18T03:28:13.984 INFO:tasks.workunit.client.1.trial078.stdout: 86.50 1.1M 1.1M 0.0k 11.4M 10.7M 0.0k nvme8n17 2026-02-18T03:28:13.985 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.2M 1.3M 0.0k 11.6M 12.5M 0.0k nvme8n18 2026-02-18T03:28:13.985 INFO:tasks.workunit.client.1.trial078.stdout: 83.30 1.2M 1.1M 0.0k 11.7M 11.2M 0.0k nvme8n19 2026-02-18T03:28:13.985 INFO:tasks.workunit.client.1.trial078.stdout: 91.10 1.2M 1.2M 0.0k 11.9M 12.2M 0.0k nvme8n20 2026-02-18T03:28:13.985 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:14.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:14 trial119 ceph-mon[24143]: pgmap v419: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.92k op/s 2026-02-18T03:28:14.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:14 trial114 ceph-mon[23907]: pgmap v419: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.92k op/s 2026-02-18T03:28:15.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:14 trial097 ceph-mon[21799]: pgmap v419: 33 pgs: 33 active+clean; 60 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.92k op/s 2026-02-18T03:28:15.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:15 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1671697260' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:15.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:15 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3127801879' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:15.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:15 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2813987234' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:15.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:15 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1671697260' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:15.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:15 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3127801879' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:15.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:15 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2813987234' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:16.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1671697260' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:16.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3127801879' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:16.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:15 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2813987234' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:16.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:16 trial119 ceph-mon[24143]: pgmap v420: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 6.21k op/s 2026-02-18T03:28:16.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:16 trial114 ceph-mon[23907]: pgmap v420: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 6.21k op/s 2026-02-18T03:28:17.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:16 trial097 ceph-mon[21799]: pgmap v420: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 78 MiB/s rd, 82 MiB/s wr, 6.21k op/s 2026-02-18T03:28:18.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:18 trial114 ceph-mon[23907]: pgmap v421: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.95k op/s 2026-02-18T03:28:18.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:18 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/2884190477' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:19.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:18 trial097 ceph-mon[21799]: pgmap v421: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.95k op/s 2026-02-18T03:28:19.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:18 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/2884190477' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:19.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:18 trial119 ceph-mon[24143]: pgmap v421: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.95k op/s 2026-02-18T03:28:19.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:18 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/2884190477' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:20.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:20 trial114 ceph-mon[23907]: pgmap v422: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 64 MiB/s rd, 67 MiB/s wr, 5.12k op/s 2026-02-18T03:28:21.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:20 trial097 ceph-mon[21799]: pgmap v422: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 64 MiB/s rd, 67 MiB/s wr, 5.12k op/s 2026-02-18T03:28:21.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:20 trial119 ceph-mon[24143]: pgmap v422: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 64 MiB/s rd, 67 MiB/s wr, 5.12k op/s 2026-02-18T03:28:22.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:22 trial114 ceph-mon[23907]: pgmap v423: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 5.60k op/s 2026-02-18T03:28:22.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:22 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1122582004' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:22.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:22 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3852160189' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:22.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:22 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3086784444' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:22 trial097 ceph-mon[21799]: pgmap v423: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 5.60k op/s 2026-02-18T03:28:23.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:22 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1122582004' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:22 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3852160189' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:22 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3086784444' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:22 trial119 ceph-mon[24143]: pgmap v423: 33 pgs: 33 active+clean; 60 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 5.60k op/s 2026-02-18T03:28:23.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:22 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1122582004' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:22 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3852160189' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:22 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3086784444' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.2M 1.1M 0.0k 11.9M 10.7M 0.0k nvme12n1 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.1M 1.1M 0.0k 11.0M 11.1M 0.0k nvme12n10 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 83.70 1.0M 1.1M 0.0k 10.4M 11.0M 0.0k nvme12n2 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.90 1.1M 1.1M 0.0k 10.7M 10.9M 0.0k nvme12n3 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 79.40 1.1M 1.1M 0.0k 10.7M 11.0M 0.0k nvme12n4 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 84.30 1.2M 1.0M 0.0k 12.1M 10.4M 0.0k nvme12n5 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.2M 1.1M 0.0k 12.1M 10.7M 0.0k nvme12n6 2026-02-18T03:28:23.500 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 1.2M 1.1M 0.0k 11.6M 11.5M 0.0k nvme12n7 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 83.20 1.1M 1.1M 0.0k 10.7M 10.8M 0.0k nvme12n8 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.2M 1.2M 0.0k 11.9M 12.1M 0.0k nvme12n9 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 87.10 1.2M 1.1M 0.0k 11.6M 11.5M 0.0k nvme4n1 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 94.50 1.3M 1.2M 0.0k 12.7M 11.5M 0.0k nvme4n10 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.90 1.1M 1.2M 0.0k 10.9M 11.9M 0.0k nvme4n2 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 95.10 1.3M 1.2M 0.0k 12.7M 12.1M 0.0k nvme4n3 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.80 1.2M 1.2M 0.0k 11.7M 11.5M 0.0k nvme4n4 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.1M 1.0M 0.0k 11.3M 10.4M 0.0k nvme4n5 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 92.00 1.2M 1.3M 0.0k 12.3M 12.6M 0.0k nvme4n6 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 91.20 1.3M 1.2M 0.0k 12.5M 11.9M 0.0k nvme4n7 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 85.20 1.1M 1.1M 0.0k 11.2M 10.8M 0.0k nvme4n8 2026-02-18T03:28:23.501 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.1M 1.2M 0.0k 11.5M 12.2M 0.0k nvme4n9 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.2M 1.3M 0.0k 11.6M 12.6M 0.0k nvme8n1 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.70 1.1M 1.1M 0.0k 11.3M 11.1M 0.0k nvme8n10 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 87.20 1.0M 1.2M 0.0k 10.1M 11.6M 0.0k nvme8n2 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 1.2M 1.1M 0.0k 12.5M 11.5M 0.0k nvme8n3 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.40 1.2M 1.1M 0.0k 11.7M 11.3M 0.0k nvme8n4 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 84.80 1.1M 1.2M 0.0k 10.6M 12.5M 0.0k nvme8n5 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 88.30 1.1M 1.3M 0.0k 10.9M 12.7M 0.0k nvme8n6 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.2M 1.1M 0.0k 12.0M 11.4M 0.0k nvme8n7 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 89.00 1.1M 1.2M 0.0k 11.0M 11.7M 0.0k nvme8n8 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 92.30 1.1M 1.2M 0.0k 11.5M 11.7M 0.0k nvme8n9 2026-02-18T03:28:23.502 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:23.975 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 86.60 1.2M 1.0M 0.0k 11.6M 10.4M 0.0k nvme12n11 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 1.1M 1.2M 0.0k 10.9M 11.6M 0.0k nvme12n12 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 89.10 1.1M 1.1M 0.0k 10.8M 11.4M 0.0k nvme12n13 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.2M 1.2M 0.0k 11.7M 12.0M 0.0k nvme12n14 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 84.50 1.1M 1.2M 0.0k 10.7M 12.0M 0.0k nvme12n15 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 1.1M 1.1M 0.0k 11.2M 11.2M 0.0k nvme12n16 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 1.1M 1.2M 0.0k 11.4M 12.0M 0.0k nvme12n17 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 81.90 994.8k 1.2M 0.0k 9.7M 11.7M 0.0k nvme12n18 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 84.30 1.1M 1.1M 0.0k 10.8M 11.4M 0.0k nvme12n19 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.1M 1.1M 0.0k 11.3M 11.2M 0.0k nvme12n20 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 90.70 1.2M 1.2M 0.0k 11.6M 12.1M 0.0k nvme4n11 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.2M 1.2M 0.0k 12.0M 12.0M 0.0k nvme4n12 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 82.00 1.1M 1.2M 0.0k 10.9M 11.9M 0.0k nvme4n13 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 92.40 1.2M 1.2M 0.0k 11.6M 12.0M 0.0k nvme4n14 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.2M 1.1M 0.0k 11.7M 11.2M 0.0k nvme4n15 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 85.40 1.0M 1.1M 0.0k 10.3M 10.7M 0.0k nvme4n16 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 1.3M 1.2M 0.0k 12.8M 11.7M 0.0k nvme4n17 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 92.30 1.2M 1.2M 0.0k 12.1M 11.8M 0.0k nvme4n18 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 88.10 1.1M 1.1M 0.0k 10.9M 11.0M 0.0k nvme4n19 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 84.60 1.1M 1.2M 0.0k 11.2M 11.6M 0.0k nvme4n20 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 93.40 1.2M 1.2M 0.0k 11.8M 11.6M 0.0k nvme8n11 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 95.10 1.1M 1.2M 0.0k 11.4M 11.9M 0.0k nvme8n12 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 84.40 1.1M 1.1M 0.0k 10.6M 11.2M 0.0k nvme8n13 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 82.00 1.0M 1.1M 0.0k 10.3M 10.6M 0.0k nvme8n14 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 87.10 1.1M 1.2M 0.0k 10.6M 12.2M 0.0k nvme8n15 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 81.40 1011.6k 1.2M 0.0k 9.9M 11.5M 0.0k nvme8n16 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 99.50 1.4M 1.2M 0.0k 14.1M 12.3M 0.0k nvme8n17 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 91.60 1.2M 1.1M 0.0k 11.5M 11.2M 0.0k nvme8n18 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 90.80 1.2M 1.2M 0.0k 12.2M 12.4M 0.0k nvme8n19 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 88.00 1.1M 1.3M 0.0k 11.3M 12.5M 0.0k nvme8n20 2026-02-18T03:28:23.978 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:24.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:24 trial114 ceph-mon[23907]: pgmap v424: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.98k op/s 2026-02-18T03:28:25.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:24 trial097 ceph-mon[21799]: pgmap v424: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.98k op/s 2026-02-18T03:28:25.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:24 trial119 ceph-mon[24143]: pgmap v424: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 62 MiB/s rd, 65 MiB/s wr, 4.98k op/s 2026-02-18T03:28:26.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:25 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1334077850' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:26.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:25 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1334077850' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:26.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:25 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1334077850' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:27.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:26 trial097 ceph-mon[21799]: pgmap v425: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 6.25k op/s 2026-02-18T03:28:27.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:26 trial119 ceph-mon[24143]: pgmap v425: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 6.25k op/s 2026-02-18T03:28:27.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:26 trial114 ceph-mon[23907]: pgmap v425: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 77 MiB/s rd, 81 MiB/s wr, 6.25k op/s 2026-02-18T03:28:29.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:28 trial097 ceph-mon[21799]: pgmap v426: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 4.97k op/s 2026-02-18T03:28:29.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:28 trial119 ceph-mon[24143]: pgmap v426: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 4.97k op/s 2026-02-18T03:28:29.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:28 trial114 ceph-mon[23907]: pgmap v426: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 64 MiB/s wr, 4.97k op/s 2026-02-18T03:28:30.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:29 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/1865394382' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:29 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/1833788407' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:29 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/1227435543' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:29 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/1865394382' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:29 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/1833788407' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:29 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/1227435543' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:29 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/1865394382' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:29 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/1833788407' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:29 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/1227435543' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:31.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:30 trial097 ceph-mon[21799]: pgmap v427: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 5.12k op/s 2026-02-18T03:28:31.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:30 trial119 ceph-mon[24143]: pgmap v427: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 5.12k op/s 2026-02-18T03:28:31.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:30 trial114 ceph-mon[23907]: pgmap v427: 33 pgs: 33 active+clean; 60 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 66 MiB/s wr, 5.12k op/s 2026-02-18T03:28:33.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:32 trial114 ceph-mon[23907]: pgmap v428: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 5.59k op/s 2026-02-18T03:28:33.024 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:32 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/4045755107' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:33.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:32 trial097 ceph-mon[21799]: pgmap v428: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 5.59k op/s 2026-02-18T03:28:33.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:32 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/4045755107' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:33.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:32 trial119 ceph-mon[24143]: pgmap v428: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 72 MiB/s wr, 5.59k op/s 2026-02-18T03:28:33.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:32 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/4045755107' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:33.493 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 85.70 1.0M 1.1M 0.0k 10.5M 11.5M 0.0k nvme12n1 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 85.00 1.1M 1.1M 0.0k 10.6M 11.2M 0.0k nvme12n10 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 91.00 1.1M 1.2M 0.0k 11.5M 12.4M 0.0k nvme12n2 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 86.20 1.1M 1.0M 0.0k 10.8M 10.2M 0.0k nvme12n3 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 82.30 958.0k 1.1M 0.0k 9.4M 11.4M 0.0k nvme12n4 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 85.00 1.1M 1.1M 0.0k 11.2M 10.6M 0.0k nvme12n5 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 95.00 1.3M 1.1M 0.0k 12.8M 11.4M 0.0k nvme12n6 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 91.70 1.1M 1.1M 0.0k 11.5M 11.1M 0.0k nvme12n7 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 83.00 1.1M 1.1M 0.0k 11.1M 10.7M 0.0k nvme12n8 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 88.70 1.2M 1.1M 0.0k 11.8M 11.4M 0.0k nvme12n9 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 88.10 1.1M 1.2M 0.0k 11.2M 12.0M 0.0k nvme4n1 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 84.70 1.1M 1.1M 0.0k 10.6M 11.2M 0.0k nvme4n10 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 86.70 1.1M 1.1M 0.0k 10.7M 11.1M 0.0k nvme4n2 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 92.10 1.1M 1.2M 0.0k 11.3M 12.0M 0.0k nvme4n3 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 1.2M 1.1M 0.0k 11.8M 11.3M 0.0k nvme4n4 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 91.90 1.1M 1.2M 0.0k 11.3M 12.0M 0.0k nvme4n5 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.00 1.2M 1.1M 0.0k 11.6M 11.3M 0.0k nvme4n6 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 85.80 1.1M 1.1M 0.0k 10.7M 11.3M 0.0k nvme4n7 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 83.70 1.1M 1.1M 0.0k 10.8M 10.7M 0.0k nvme4n8 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 87.70 1.1M 1.1M 0.0k 11.1M 11.4M 0.0k nvme4n9 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 89.10 1.2M 1.2M 0.0k 11.9M 11.6M 0.0k nvme8n1 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 84.10 1.1M 1.1M 0.0k 11.2M 10.6M 0.0k nvme8n10 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 90.30 1.1M 1.1M 0.0k 11.5M 11.4M 0.0k nvme8n2 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 86.30 1.0M 1.2M 0.0k 10.3M 12.5M 0.0k nvme8n3 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 83.10 1.1M 1.1M 0.0k 10.5M 11.0M 0.0k nvme8n4 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 86.00 1.1M 1.1M 0.0k 10.9M 11.1M 0.0k nvme8n5 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 93.10 1.2M 1.2M 0.0k 12.1M 11.8M 0.0k nvme8n6 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 91.70 1.3M 1.1M 0.0k 13.0M 11.5M 0.0k nvme8n7 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 85.00 1.1M 1.1M 0.0k 10.9M 11.2M 0.0k nvme8n8 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 1.1M 1.1M 0.0k 10.6M 10.9M 0.0k nvme8n9 2026-02-18T03:28:33.495 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:33.976 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:33.982 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 82.00 1.0M 1.1M 0.0k 10.1M 11.0M 0.0k nvme12n11 2026-02-18T03:28:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.70 1.1M 1.2M 0.0k 11.2M 11.9M 0.0k nvme12n12 2026-02-18T03:28:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.1M 1.2M 0.0k 11.1M 11.6M 0.0k nvme12n13 2026-02-18T03:28:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.20 1.2M 1.1M 0.0k 12.4M 11.2M 0.0k nvme12n14 2026-02-18T03:28:33.982 INFO:tasks.workunit.client.1.trial078.stdout: 90.50 1.3M 1.1M 0.0k 13.2M 11.0M 0.0k nvme12n15 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1.2M 1.1M 0.0k 12.0M 10.9M 0.0k nvme12n16 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.60 1.1M 1.1M 0.0k 11.4M 10.9M 0.0k nvme12n17 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 82.30 1.1M 1.0M 0.0k 10.9M 10.0M 0.0k nvme12n18 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 81.80 1.1M 1.0M 0.0k 10.8M 10.5M 0.0k nvme12n19 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.70 1.2M 1.2M 0.0k 11.8M 11.7M 0.0k nvme12n20 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 86.60 1.1M 1.3M 0.0k 10.9M 12.5M 0.0k nvme4n11 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.2M 1.1M 0.0k 11.8M 10.8M 0.0k nvme4n12 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 89.70 1.2M 1.1M 0.0k 11.8M 10.9M 0.0k nvme4n13 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 92.50 1.2M 1.1M 0.0k 12.2M 11.4M 0.0k nvme4n14 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 91.40 1.1M 1.1M 0.0k 11.3M 11.2M 0.0k nvme4n15 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 95.40 1.3M 1.2M 0.0k 12.9M 11.6M 0.0k nvme4n16 2026-02-18T03:28:33.983 INFO:tasks.workunit.client.1.trial078.stdout: 88.60 1.3M 1.2M 0.0k 12.6M 11.5M 0.0k nvme4n17 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 94.20 1.1M 1.2M 0.0k 11.5M 11.9M 0.0k nvme4n18 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 94.40 1.2M 1.2M 0.0k 11.9M 11.6M 0.0k nvme4n19 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 83.90 1.2M 1.1M 0.0k 11.7M 10.8M 0.0k nvme4n20 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 94.10 1.1M 1.2M 0.0k 11.0M 11.5M 0.0k nvme8n11 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 97.10 1.2M 1.1M 0.0k 12.0M 11.3M 0.0k nvme8n12 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 86.80 1.1M 1.1M 0.0k 11.2M 11.4M 0.0k nvme8n13 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 85.70 1.1M 1.1M 0.0k 11.4M 11.0M 0.0k nvme8n14 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 84.50 1.1M 1.1M 0.0k 10.5M 11.0M 0.0k nvme8n15 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 85.20 1.1M 1.1M 0.0k 11.4M 10.6M 0.0k nvme8n16 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.1M 1.1M 0.0k 11.2M 11.2M 0.0k nvme8n17 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 90.30 1.0M 1.2M 0.0k 10.5M 12.4M 0.0k nvme8n18 2026-02-18T03:28:33.984 INFO:tasks.workunit.client.1.trial078.stdout: 85.00 1.1M 1.1M 0.0k 11.3M 11.4M 0.0k nvme8n19 2026-02-18T03:28:33.985 INFO:tasks.workunit.client.1.trial078.stdout: 89.30 1.2M 1.2M 0.0k 11.6M 11.7M 0.0k nvme8n20 2026-02-18T03:28:33.985 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:35.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:34 trial097 ceph-mon[21799]: pgmap v429: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 4.95k op/s 2026-02-18T03:28:35.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:34 trial119 ceph-mon[24143]: pgmap v429: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 4.95k op/s 2026-02-18T03:28:35.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:34 trial114 ceph-mon[23907]: pgmap v429: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 4.95k op/s 2026-02-18T03:28:37.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:36 trial097 ceph-mon[21799]: pgmap v430: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 5.73k op/s 2026-02-18T03:28:37.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:36 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3758001525' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:36 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/2802494341' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:36 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/3650784799' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:36 trial119 ceph-mon[24143]: pgmap v430: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 5.73k op/s 2026-02-18T03:28:37.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:36 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3758001525' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:36 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/2802494341' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:36 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/3650784799' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:36 trial114 ceph-mon[23907]: pgmap v430: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 73 MiB/s wr, 5.73k op/s 2026-02-18T03:28:37.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:36 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3758001525' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:36 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/2802494341' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:36 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/3650784799' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:39.157 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:38 trial097 ceph-mon[21799]: pgmap v431: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 4.97k op/s 2026-02-18T03:28:39.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:38 trial119 ceph-mon[24143]: pgmap v431: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 4.97k op/s 2026-02-18T03:28:39.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:38 trial114 ceph-mon[23907]: pgmap v431: 33 pgs: 33 active+clean; 60 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 4.97k op/s 2026-02-18T03:28:40.115 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:39 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/1030915476' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:40.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:39 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/1030915476' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:40.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:39 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/1030915476' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:41.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:40 trial097 ceph-mon[21799]: pgmap v432: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 65 MiB/s wr, 5.11k op/s 2026-02-18T03:28:41.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:40 trial119 ceph-mon[24143]: pgmap v432: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 65 MiB/s wr, 5.11k op/s 2026-02-18T03:28:41.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:40 trial114 ceph-mon[23907]: pgmap v432: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 65 MiB/s wr, 5.11k op/s 2026-02-18T03:28:43.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:42 trial097 ceph-mon[21799]: pgmap v433: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 70 MiB/s wr, 5.57k op/s 2026-02-18T03:28:43.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:42 trial119 ceph-mon[24143]: pgmap v433: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 70 MiB/s wr, 5.57k op/s 2026-02-18T03:28:43.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:42 trial114 ceph-mon[23907]: pgmap v433: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 68 MiB/s rd, 70 MiB/s wr, 5.57k op/s 2026-02-18T03:28:43.494 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:43.497 INFO:tasks.workunit.client.0.trial031.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 88.50 1.1M 1.1M 0.0k 11.5M 10.7M 0.0k nvme12n1 2026-02-18T03:28:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 90.70 1.1M 1.1M 0.0k 11.4M 11.2M 0.0k nvme12n10 2026-02-18T03:28:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 87.60 1.2M 1.1M 0.0k 11.6M 10.8M 0.0k nvme12n2 2026-02-18T03:28:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 92.40 1.1M 1.2M 0.0k 11.4M 12.0M 0.0k nvme12n3 2026-02-18T03:28:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 91.30 1.2M 1.2M 0.0k 11.9M 12.1M 0.0k nvme12n4 2026-02-18T03:28:43.497 INFO:tasks.workunit.client.0.trial031.stdout: 83.90 1.1M 1.2M 0.0k 10.7M 12.0M 0.0k nvme12n5 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 84.70 1.1M 1.0M 0.0k 10.8M 10.3M 0.0k nvme12n6 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.20 1.0M 1.1M 0.0k 10.2M 11.0M 0.0k nvme12n7 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 88.00 1.1M 1.1M 0.0k 11.0M 11.3M 0.0k nvme12n8 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.30 1.1M 1.2M 0.0k 10.9M 11.9M 0.0k nvme12n9 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.40 1.2M 1.3M 0.0k 12.4M 13.1M 0.0k nvme4n1 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 83.00 1.0M 1.1M 0.0k 10.3M 10.8M 0.0k nvme4n10 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.2M 1.1M 0.0k 12.0M 10.9M 0.0k nvme4n2 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.60 1.2M 1.1M 0.0k 11.6M 10.8M 0.0k nvme4n3 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.20 1.1M 1.1M 0.0k 10.7M 11.1M 0.0k nvme4n4 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.80 1.3M 1.1M 0.0k 13.0M 10.8M 0.0k nvme4n5 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 83.90 1.1M 1.0M 0.0k 10.5M 10.5M 0.0k nvme4n6 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 86.20 1.1M 1.1M 0.0k 10.9M 11.2M 0.0k nvme4n7 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.50 1.2M 1.2M 0.0k 11.6M 11.7M 0.0k nvme4n8 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.40 1.2M 1.1M 0.0k 11.6M 11.2M 0.0k nvme4n9 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 93.00 1.2M 1.2M 0.0k 11.9M 11.6M 0.0k nvme8n1 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 87.90 1.1M 1.1M 0.0k 10.9M 11.0M 0.0k nvme8n10 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.90 1.2M 1.1M 0.0k 11.8M 10.7M 0.0k nvme8n2 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 92.20 1.2M 1.1M 0.0k 11.5M 10.9M 0.0k nvme8n3 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 85.40 1.0M 1.1M 0.0k 10.1M 10.9M 0.0k nvme8n4 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 84.10 1.0M 1.1M 0.0k 10.4M 10.7M 0.0k nvme8n5 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 84.70 1.1M 1.1M 0.0k 10.7M 11.0M 0.0k nvme8n6 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 89.90 1.2M 1.1M 0.0k 11.6M 10.9M 0.0k nvme8n7 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 91.40 1.1M 1.1M 0.0k 11.3M 11.5M 0.0k nvme8n8 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 90.20 1.0M 1.1M 0.0k 10.5M 10.7M 0.0k nvme8n9 2026-02-18T03:28:43.498 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:43.499 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:43.976 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:43.979 INFO:tasks.workunit.client.1.trial078.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 81.20 1.1M 1021.6k 0.0k 10.5M 10.0M 0.0k nvme12n11 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 1.1M 1.2M 0.0k 11.2M 11.8M 0.0k nvme12n12 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 89.00 1.1M 1.0M 0.0k 11.2M 10.3M 0.0k nvme12n13 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.90 1.2M 1.1M 0.0k 11.7M 11.3M 0.0k nvme12n14 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 87.60 1.2M 1.1M 0.0k 12.0M 10.6M 0.0k nvme12n15 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.2M 1.1M 0.0k 12.4M 10.9M 0.0k nvme12n16 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 85.30 1.0M 1.1M 0.0k 10.4M 10.8M 0.0k nvme12n17 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 84.40 1.1M 1.1M 0.0k 11.2M 11.1M 0.0k nvme12n18 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 80.40 1.0M 1.1M 0.0k 10.1M 11.1M 0.0k nvme12n19 2026-02-18T03:28:43.980 INFO:tasks.workunit.client.1.trial078.stdout: 90.60 1.1M 1.2M 0.0k 11.5M 12.1M 0.0k nvme12n20 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.90 1.2M 1.1M 0.0k 11.5M 11.4M 0.0k nvme4n11 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.80 1.1M 1.1M 0.0k 11.0M 11.3M 0.0k nvme4n12 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 89.80 1.1M 1.2M 0.0k 11.5M 11.8M 0.0k nvme4n13 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.30 1.2M 1.1M 0.0k 12.1M 11.4M 0.0k nvme4n14 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 88.20 1.2M 1.1M 0.0k 11.6M 11.1M 0.0k nvme4n15 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.1M 1.1M 0.0k 11.3M 11.2M 0.0k nvme4n16 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 84.30 1.0M 1.2M 0.0k 10.3M 11.8M 0.0k nvme4n17 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 91.90 1.2M 1.2M 0.0k 11.8M 11.9M 0.0k nvme4n18 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 86.20 1.0M 1.1M 0.0k 10.3M 11.1M 0.0k nvme4n19 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 79.00 983.2k 1.0M 0.0k 9.6M 10.1M 0.0k nvme4n20 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 92.70 1.1M 1.1M 0.0k 11.4M 11.2M 0.0k nvme8n11 2026-02-18T03:28:43.981 INFO:tasks.workunit.client.1.trial078.stdout: 93.00 1.1M 1.1M 0.0k 11.0M 11.1M 0.0k nvme8n12 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 89.40 1.2M 1.2M 0.0k 12.0M 11.6M 0.0k nvme8n13 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.20 1.0M 1.2M 0.0k 10.4M 11.6M 0.0k nvme8n14 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 87.00 1.1M 1.1M 0.0k 11.4M 10.8M 0.0k nvme8n15 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 88.00 1.1M 1.1M 0.0k 11.1M 11.5M 0.0k nvme8n16 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 91.00 1.2M 1.1M 0.0k 11.7M 11.4M 0.0k nvme8n17 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 85.70 1.1M 1.0M 0.0k 11.0M 10.5M 0.0k nvme8n18 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 83.90 1.1M 1.1M 0.0k 11.4M 11.0M 0.0k nvme8n19 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 92.20 1.2M 1.2M 0.0k 11.7M 11.9M 0.0k nvme8n20 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:43.982 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:44.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:43 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/553805832' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:44.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:43 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/3063767349' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:44.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:43 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/902996772' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:44.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:43 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/553805832' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:44.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:43 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/3063767349' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:44.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:43 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/902996772' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:44.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:43 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/553805832' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:44.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:43 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/3063767349' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:44.224 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:43 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/902996772' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:45.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:44 trial097 ceph-mon[21799]: pgmap v434: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 4.95k op/s 2026-02-18T03:28:45.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:44 trial119 ceph-mon[24143]: pgmap v434: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 4.95k op/s 2026-02-18T03:28:45.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:44 trial114 ceph-mon[23907]: pgmap v434: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 4.95k op/s 2026-02-18T03:28:47.159 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:46 trial097 ceph-mon[21799]: pgmap v435: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 72 MiB/s wr, 5.75k op/s 2026-02-18T03:28:47.159 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:46 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/3187382937' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:47.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:46 trial119 ceph-mon[24143]: pgmap v435: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 72 MiB/s wr, 5.75k op/s 2026-02-18T03:28:47.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:46 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/3187382937' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:47.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:46 trial114 ceph-mon[23907]: pgmap v435: 33 pgs: 33 active+clean; 60 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 70 MiB/s rd, 72 MiB/s wr, 5.75k op/s 2026-02-18T03:28:47.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:46 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/3187382937' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:49.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:48 trial097 ceph-mon[21799]: pgmap v436: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 67 MiB/s rd, 69 MiB/s wr, 5.47k op/s 2026-02-18T03:28:49.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:48 trial119 ceph-mon[24143]: pgmap v436: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 67 MiB/s rd, 69 MiB/s wr, 5.47k op/s 2026-02-18T03:28:49.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:48 trial114 ceph-mon[23907]: pgmap v436: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 67 MiB/s rd, 69 MiB/s wr, 5.47k op/s 2026-02-18T03:28:51.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:50 trial097 ceph-mon[21799]: pgmap v437: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 64 MiB/s wr, 5.13k op/s 2026-02-18T03:28:51.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:50 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/2032336072' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:50 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/650464437' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:50 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2715321834' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:50 trial119 ceph-mon[24143]: pgmap v437: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 64 MiB/s wr, 5.13k op/s 2026-02-18T03:28:51.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:50 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/2032336072' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.213 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:50 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/650464437' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:50 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2715321834' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:50 trial114 ceph-mon[23907]: pgmap v437: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 63 MiB/s rd, 64 MiB/s wr, 5.13k op/s 2026-02-18T03:28:51.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:50 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/2032336072' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:50 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/650464437' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:50 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2715321834' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:52.158 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:51 trial097 ceph-mon[21799]: pgmap v438: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 70 MiB/s wr, 5.63k op/s 2026-02-18T03:28:52.214 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:51 trial119 ceph-mon[24143]: pgmap v438: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 70 MiB/s wr, 5.63k op/s 2026-02-18T03:28:52.223 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:51 trial114 ceph-mon[23907]: pgmap v438: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 69 MiB/s rd, 70 MiB/s wr, 5.63k op/s 2026-02-18T03:28:53.658 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:53 trial097 ceph-mon[21799]: from='client.? 10.20.193.119:0/721834234' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:53.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:53 trial119 ceph-mon[24143]: from='client.? 10.20.193.119:0/721834234' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:53.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:53 trial114 ceph-mon[23907]: from='client.? 10.20.193.119:0/721834234' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:54.658 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:54 trial097 ceph-mon[21799]: pgmap v439: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 5.03k op/s 2026-02-18T03:28:54.714 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:54 trial119 ceph-mon[24143]: pgmap v439: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 5.03k op/s 2026-02-18T03:28:54.723 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:54 trial114 ceph-mon[23907]: pgmap v439: 33 pgs: 33 active+clean; 60 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 63 MiB/s wr, 5.03k op/s 2026-02-18T03:28:56.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:56 trial097 ceph-mon[21799]: pgmap v440: 33 pgs: 33 active+clean; 60 GiB data, 116 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 72 MiB/s wr, 5.83k op/s 2026-02-18T03:28:56.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:56 trial119 ceph-mon[24143]: pgmap v440: 33 pgs: 33 active+clean; 60 GiB data, 116 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 72 MiB/s wr, 5.83k op/s 2026-02-18T03:28:56.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:56 trial114 ceph-mon[23907]: pgmap v440: 33 pgs: 33 active+clean; 60 GiB data, 116 GiB used, 2.6 TiB / 2.7 TiB avail; 71 MiB/s rd, 72 MiB/s wr, 5.83k op/s 2026-02-18T03:28:57.581 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:57.581 INFO:tasks.workunit.client.0.trial031.stdout:job-/dev/nvme8n1: (groupid=0, jobs=30): err= 0: pid=42873: Wed Feb 18 03:28:57 2026 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: read: IOPS=1496, BW=37.6MiB/s (39.5MB/s)(22.1GiB/600017msec) 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: clat (usec): min=62, max=170929, avg=4698.86, stdev=8480.36 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: lat (usec): min=62, max=170929, avg=4698.92, stdev=8480.36 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: clat percentiles (usec): 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: | 1.00th=[ 269], 5.00th=[ 338], 10.00th=[ 371], 20.00th=[ 429], 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: | 30.00th=[ 510], 40.00th=[ 709], 50.00th=[ 1663], 60.00th=[ 2868], 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: | 70.00th=[ 4293], 80.00th=[ 6456], 90.00th=[ 11863], 95.00th=[ 19268], 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: | 99.00th=[ 42206], 99.50th=[ 54264], 99.90th=[ 83362], 99.95th=[ 95945], 2026-02-18T03:28:57.582 INFO:tasks.workunit.client.0.trial031.stdout: | 99.99th=[122160] 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: bw ( KiB/s): min= 6408, max=265602, per=100.00%, avg=38588.06, stdev=802.17, samples=35970 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: iops : min= 376, max= 7864, avg=1497.03, stdev=22.99, samples=35970 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: write: IOPS=1495, BW=37.7MiB/s (39.5MB/s)(22.1GiB/600017msec); 0 zone resets 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: clat (usec): min=984, max=193547, avg=15321.01, stdev=10647.24 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: lat (usec): min=989, max=193580, avg=15353.29, stdev=10646.85 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: clat percentiles (msec): 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: | 70.00th=[ 18], 80.00th=[ 22], 90.00th=[ 28], 95.00th=[ 35], 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: | 99.00th=[ 56], 99.50th=[ 67], 99.90th=[ 94], 99.95th=[ 106], 2026-02-18T03:28:57.583 INFO:tasks.workunit.client.0.trial031.stdout: | 99.99th=[ 133] 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: bw ( KiB/s): min=10625, max=253028, per=100.00%, avg=38592.55, stdev=756.37, samples=35970 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: iops : min= 592, max= 7490, avg=1496.41, stdev=20.56, samples=35970 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: lat (usec) : 100=0.08%, 250=0.35%, 500=14.06%, 750=5.92%, 1000=1.49% 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: lat (msec) : 2=4.87%, 4=9.81%, 10=23.97%, 20=25.85%, 50=12.58% 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: lat (msec) : 100=0.97%, 250=0.05% 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: cpu : usr=0.19%, sys=0.03%, ctx=1854056, majf=0, minf=25025 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: issued rwts: total=897837,897519,0,0 short=0,0,0,0 dropped=0,0,0,0 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: latency : target=0, window=0, percentile=100.00%, depth=1 2026-02-18T03:28:57.584 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout:Run status group 0 (all jobs): 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: READ: bw=37.6MiB/s (39.5MB/s), 37.6MiB/s-37.6MiB/s (39.5MB/s-39.5MB/s), io=22.1GiB (23.7GB), run=600017-600017msec 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: WRITE: bw=37.7MiB/s (39.5MB/s), 37.7MiB/s-37.7MiB/s (39.5MB/s-39.5MB/s), io=22.1GiB (23.7GB), run=600017-600017msec 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout:Disk stats (read/write): 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n1: ios=30102/30111, merge=0/0, ticks=139478/459131, in_queue=598609, util=99.30% 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n1: ios=29257/29453, merge=0/0, ticks=143663/454962, in_queue=598625, util=99.35% 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n1: ios=29727/29772, merge=0/0, ticks=143145/455525, in_queue=598670, util=99.39% 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n2: ios=29925/30305, merge=0/0, ticks=139088/459530, in_queue=598618, util=99.38% 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n2: ios=30441/30637, merge=0/0, ticks=133894/464723, in_queue=598617, util=99.40% 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n2: ios=29882/29474, merge=0/0, ticks=142139/456521, in_queue=598660, util=99.42% 2026-02-18T03:28:57.585 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n3: ios=30524/30513, merge=0/0, ticks=138199/460426, in_queue=598625, util=99.43% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n3: ios=29925/29839, merge=0/0, ticks=141244/457418, in_queue=598662, util=99.47% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n3: ios=30726/30873, merge=0/0, ticks=133708/464836, in_queue=598544, util=99.48% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n4: ios=29779/29494, merge=0/0, ticks=143535/455041, in_queue=598576, util=99.52% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n4: ios=29199/29313, merge=0/0, ticks=142914/455769, in_queue=598683, util=99.55% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n4: ios=29622/29932, merge=0/0, ticks=138931/459718, in_queue=598649, util=99.55% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n5: ios=30154/29861, merge=0/0, ticks=140478/458134, in_queue=598612, util=99.56% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n5: ios=28372/28411, merge=0/0, ticks=148569/450146, in_queue=598715, util=99.61% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n5: ios=30513/30224, merge=0/0, ticks=142916/455734, in_queue=598650, util=99.62% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n6: ios=29418/29761, merge=0/0, ticks=137860/460824, in_queue=598684, util=99.66% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n6: ios=30621/30119, merge=0/0, ticks=142164/456565, in_queue=598729, util=99.67% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n6: ios=29309/29362, merge=0/0, ticks=140859/457728, in_queue=598587, util=99.66% 2026-02-18T03:28:57.586 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n7: ios=30128/30155, merge=0/0, ticks=140001/458611, in_queue=598612, util=99.67% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n7: ios=30942/31135, merge=0/0, ticks=132801/465873, in_queue=598674, util=99.71% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n7: ios=29616/29795, merge=0/0, ticks=143436/455177, in_queue=598613, util=99.72% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n8: ios=29840/29615, merge=0/0, ticks=140346/458340, in_queue=598686, util=99.76% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n8: ios=29916/29736, merge=0/0, ticks=141621/456988, in_queue=598609, util=99.75% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n8: ios=29665/29685, merge=0/0, ticks=141925/456777, in_queue=598702, util=99.81% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n9: ios=31900/31464, merge=0/0, ticks=132579/466044, in_queue=598623, util=99.80% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n9: ios=29703/29654, merge=0/0, ticks=143470/455126, in_queue=598596, util=99.82% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n9: ios=29392/29424, merge=0/0, ticks=141069/457587, in_queue=598656, util=99.85% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme8n10: ios=30323/30393, merge=0/0, ticks=137491/461126, in_queue=598617, util=99.87% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme12n10: ios=29348/29428, merge=0/0, ticks=144126/454551, in_queue=598677, util=99.89% 2026-02-18T03:28:57.587 INFO:tasks.workunit.client.0.trial031.stdout: nvme4n10: ios=29543/29536, merge=0/0, ticks=142901/455692, in_queue=598593, util=99.88% 2026-02-18T03:28:57.588 INFO:tasks.workunit.client.0.trial031.stderr:+ '[' 0 -ne 0 ']' 2026-02-18T03:28:57.589 INFO:tasks.workunit.client.0.trial031.stdout:[nvmeof.fio] fio test successful! 2026-02-18T03:28:57.590 INFO:tasks.workunit.client.0.trial031.stderr:+ echo '[nvmeof.fio] fio test successful!' 2026-02-18T03:28:57.590 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T03:28:57.591 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T03:28:57.662 INFO:tasks.workunit:Stopping ['nvmeof/basic_tests.sh', 'nvmeof/fio_test.sh --start_ns 1 --end_ns 30 --rbd_iostat'] on client.0... 2026-02-18T03:28:57.662 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout:job-/dev/nvme8n11: (groupid=0, jobs=30): err= 0: pid=28191: Wed Feb 18 03:28:57 2026 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: read: IOPS=1501, BW=37.8MiB/s (39.6MB/s)(22.1GiB/600011msec) 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: clat (usec): min=60, max=188718, avg=4635.92, stdev=8422.60 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: lat (usec): min=60, max=188718, avg=4635.98, stdev=8422.60 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: clat percentiles (usec): 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 1.00th=[ 269], 5.00th=[ 334], 10.00th=[ 367], 20.00th=[ 429], 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 30.00th=[ 506], 40.00th=[ 685], 50.00th=[ 1631], 60.00th=[ 2835], 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 70.00th=[ 4228], 80.00th=[ 6390], 90.00th=[ 11600], 95.00th=[ 18744], 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 99.00th=[ 42206], 99.50th=[ 53740], 99.90th=[ 83362], 99.95th=[ 95945], 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 99.99th=[124257] 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: bw ( KiB/s): min= 6768, max=230296, per=100.00%, avg=38700.05, stdev=776.49, samples=35970 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: iops : min= 388, max= 6762, avg=1501.41, stdev=22.21, samples=35970 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: write: IOPS=1500, BW=37.8MiB/s (39.6MB/s)(22.1GiB/600011msec); 0 zone resets 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: clat (usec): min=966, max=182455, avg=15319.26, stdev=10609.63 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: lat (usec): min=971, max=182476, avg=15351.08, stdev=10609.27 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: clat percentiles (msec): 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 70.00th=[ 18], 80.00th=[ 21], 90.00th=[ 28], 95.00th=[ 35], 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 99.00th=[ 56], 99.50th=[ 67], 99.90th=[ 94], 99.95th=[ 108], 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: | 99.99th=[ 133] 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: bw ( KiB/s): min=11136, max=219536, per=100.00%, avg=38702.73, stdev=728.87, samples=35970 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: iops : min= 654, max= 6348, avg=1500.63, stdev=19.69, samples=35970 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: lat (usec) : 100=0.09%, 250=0.33%, 500=14.34%, 750=5.91%, 1000=1.46% 2026-02-18T03:28:57.886 INFO:tasks.workunit.client.1.trial078.stdout: lat (msec) : 2=4.76%, 4=9.62%, 10=24.11%, 20=25.92%, 50=12.44% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: lat (msec) : 100=0.96%, 250=0.06% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: cpu : usr=0.19%, sys=0.03%, ctx=1859362, majf=0, minf=25031 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: issued rwts: total=900913,900388,0,0 short=0,0,0,0 dropped=0,0,0,0 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: latency : target=0, window=0, percentile=100.00%, depth=1 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout:Run status group 0 (all jobs): 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: READ: bw=37.8MiB/s (39.6MB/s), 37.8MiB/s-37.8MiB/s (39.6MB/s-39.6MB/s), io=22.1GiB (23.8GB), run=600011-600011msec 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: WRITE: bw=37.8MiB/s (39.6MB/s), 37.8MiB/s-37.8MiB/s (39.6MB/s-39.6MB/s), io=22.1GiB (23.8GB), run=600011-600011msec 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout:Disk stats (read/write): 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n11: ios=31618/31664, merge=0/0, ticks=131056/467492, in_queue=598548, util=99.30% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n11: ios=29227/29425, merge=0/0, ticks=142833/455714, in_queue=598547, util=99.34% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n11: ios=30037/30083, merge=0/0, ticks=140085/458501, in_queue=598586, util=99.37% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n12: ios=31255/31621, merge=0/0, ticks=131882/466603, in_queue=598485, util=99.38% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n12: ios=29752/29991, merge=0/0, ticks=137313/461293, in_queue=598606, util=99.40% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n12: ios=31106/30688, merge=0/0, ticks=135254/463276, in_queue=598530, util=99.43% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n13: ios=29598/29556, merge=0/0, ticks=141448/457103, in_queue=598551, util=99.43% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n13: ios=30079/30022, merge=0/0, ticks=138466/460117, in_queue=598583, util=99.46% 2026-02-18T03:28:57.887 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n13: ios=29016/29209, merge=0/0, ticks=144776/453844, in_queue=598620, util=99.48% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n14: ios=29629/29306, merge=0/0, ticks=143243/455390, in_queue=598633, util=99.50% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n14: ios=30231/30265, merge=0/0, ticks=134271/464232, in_queue=598503, util=99.49% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n14: ios=30244/30547, merge=0/0, ticks=136100/462434, in_queue=598534, util=99.52% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n15: ios=30260/29994, merge=0/0, ticks=140809/457784, in_queue=598593, util=99.57% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n15: ios=29245/29233, merge=0/0, ticks=141086/457486, in_queue=598572, util=99.59% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n15: ios=30681/30410, merge=0/0, ticks=134178/464389, in_queue=598567, util=99.60% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n16: ios=29578/29907, merge=0/0, ticks=138283/460291, in_queue=598574, util=99.61% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n16: ios=30239/29756, merge=0/0, ticks=140486/458117, in_queue=598603, util=99.62% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n16: ios=30350/30304, merge=0/0, ticks=138881/459659, in_queue=598540, util=99.63% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n17: ios=30653/30628, merge=0/0, ticks=133682/464805, in_queue=598487, util=99.66% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n17: ios=29937/30113, merge=0/0, ticks=140712/457865, in_queue=598577, util=99.69% 2026-02-18T03:28:57.888 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n17: ios=28935/29134, merge=0/0, ticks=143276/455291, in_queue=598567, util=99.70% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n18: ios=30805/30583, merge=0/0, ticks=134161/464359, in_queue=598520, util=99.69% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n18: ios=29153/28962, merge=0/0, ticks=144554/453950, in_queue=598504, util=99.73% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n18: ios=30657/30680, merge=0/0, ticks=131829/466682, in_queue=598511, util=99.75% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n19: ios=29877/29414, merge=0/0, ticks=142156/456461, in_queue=598617, util=99.80% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n19: ios=29658/29592, merge=0/0, ticks=142799/455736, in_queue=598535, util=99.80% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n19: ios=29933/29992, merge=0/0, ticks=140805/457752, in_queue=598557, util=99.81% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme8n20: ios=29726/29801, merge=0/0, ticks=140221/458384, in_queue=598605, util=99.84% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme12n20: ios=30383/30414, merge=0/0, ticks=138640/459882, in_queue=598522, util=99.83% 2026-02-18T03:28:57.889 INFO:tasks.workunit.client.1.trial078.stdout: nvme4n20: ios=28803/28834, merge=0/0, ticks=148653/449974, in_queue=598627, util=99.89% 2026-02-18T03:28:57.890 INFO:tasks.workunit.client.1.trial078.stderr:+ '[' 0 -ne 0 ']' 2026-02-18T03:28:57.890 INFO:tasks.workunit.client.1.trial078.stderr:+ echo '[nvmeof.fio] fio test successful!' 2026-02-18T03:28:57.891 INFO:tasks.workunit.client.1.trial078.stdout:[nvmeof.fio] fio test successful! 2026-02-18T03:28:57.891 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T03:28:57.892 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2026-02-18T03:28:57.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:57 trial097 ceph-mon[21799]: from='client.? 10.20.193.97:0/3504778349' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:57.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:57 trial097 ceph-mon[21799]: from='client.? 10.20.193.114:0/382361129' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:57.908 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:57 trial097 ceph-mon[21799]: from='client.? 10.20.193.194:0/2377586998' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:57.959 INFO:tasks.workunit:Stopping ['nvmeof/basic_tests.sh', 'nvmeof/fio_test.sh --start_ns 31 --end_ns 60'] on client.1... 2026-02-18T03:28:57.959 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2026-02-18T03:28:57.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:57 trial119 ceph-mon[24143]: from='client.? 10.20.193.97:0/3504778349' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:57.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:57 trial119 ceph-mon[24143]: from='client.? 10.20.193.114:0/382361129' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:57.964 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:57 trial119 ceph-mon[24143]: from='client.? 10.20.193.194:0/2377586998' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:57.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:57 trial114 ceph-mon[23907]: from='client.? 10.20.193.97:0/3504778349' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:57.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:57 trial114 ceph-mon[23907]: from='client.? 10.20.193.114:0/382361129' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:57.974 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:57 trial114 ceph-mon[23907]: from='client.? 10.20.193.194:0/2377586998' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:58.018 DEBUG:teuthology.parallel:result is None 2026-02-18T03:28:58.313 DEBUG:teuthology.parallel:result is None 2026-02-18T03:28:58.314 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:28:58.341 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:28:58.341 DEBUG:teuthology.orchestra.run.trial031:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:28:58.400 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:28:58.400 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2026-02-18T03:28:58.427 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2026-02-18T03:28:58.427 DEBUG:teuthology.orchestra.run.trial078:> rmdir -- /home/ubuntu/cephtest/mnt.1 2026-02-18T03:28:58.484 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.1/client.1 2026-02-18T03:28:58.484 DEBUG:teuthology.run_tasks:Unwinding manager nvmeof 2026-02-18T03:28:58.496 INFO:tasks.nvmeof:[nvmeof] Removing nvmeof service 2026-02-18T03:28:58.496 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host ls 2026-02-18T03:28:58.613 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:28:58.853 INFO:teuthology.orchestra.run.trial097.stdout:HOST ADDR LABELS STATUS 2026-02-18T03:28:58.853 INFO:teuthology.orchestra.run.trial097.stdout:trial031 10.20.193.31 2026-02-18T03:28:58.853 INFO:teuthology.orchestra.run.trial097.stdout:trial078 10.20.193.78 2026-02-18T03:28:58.853 INFO:teuthology.orchestra.run.trial097.stdout:trial097 10.20.193.97 2026-02-18T03:28:58.853 INFO:teuthology.orchestra.run.trial097.stdout:trial114 10.20.193.114 2026-02-18T03:28:58.853 INFO:teuthology.orchestra.run.trial097.stdout:trial119 10.20.193.119 2026-02-18T03:28:58.853 INFO:teuthology.orchestra.run.trial097.stdout:trial194 10.20.193.194 2026-02-18T03:28:58.853 INFO:teuthology.orchestra.run.trial097.stdout:6 hosts in cluster 2026-02-18T03:28:58.854 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:28:58 trial097 ceph-mon[21799]: pgmap v441: 33 pgs: 33 active+clean; 60 GiB data, 116 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 62 MiB/s wr, 5.04k op/s 2026-02-18T03:28:58.891 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch rm nvmeof.mypool.mygroup0 2026-02-18T03:28:58.963 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:28:58 trial119 ceph-mon[24143]: pgmap v441: 33 pgs: 33 active+clean; 60 GiB data, 116 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 62 MiB/s wr, 5.04k op/s 2026-02-18T03:28:58.973 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:28:58 trial114 ceph-mon[23907]: pgmap v441: 33 pgs: 33 active+clean; 60 GiB data, 116 GiB used, 2.6 TiB / 2.7 TiB avail; 61 MiB/s rd, 62 MiB/s wr, 5.04k op/s 2026-02-18T03:28:59.008 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:28:59.255 INFO:teuthology.orchestra.run.trial097.stdout:Removed service nvmeof.mypool.mygroup0 2026-02-18T03:28:59.296 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph orch host ls 2026-02-18T03:28:59.408 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:28:59.645 INFO:teuthology.orchestra.run.trial097.stdout:HOST ADDR LABELS STATUS 2026-02-18T03:28:59.645 INFO:teuthology.orchestra.run.trial097.stdout:trial031 10.20.193.31 2026-02-18T03:28:59.645 INFO:teuthology.orchestra.run.trial097.stdout:trial078 10.20.193.78 2026-02-18T03:28:59.645 INFO:teuthology.orchestra.run.trial097.stdout:trial097 10.20.193.97 2026-02-18T03:28:59.645 INFO:teuthology.orchestra.run.trial097.stdout:trial114 10.20.193.114 2026-02-18T03:28:59.645 INFO:teuthology.orchestra.run.trial097.stdout:trial119 10.20.193.119 2026-02-18T03:28:59.646 INFO:teuthology.orchestra.run.trial097.stdout:trial194 10.20.193.194 2026-02-18T03:28:59.646 INFO:teuthology.orchestra.run.trial097.stdout:6 hosts in cluster 2026-02-18T03:28:59.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:28:59 trial097 systemd[1]: Stopping Ceph nvmeof.nvmeof.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:28:59.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:28:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:28:59] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:28:59.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:28:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:28:59] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:28:59.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:28:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:28:59] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.a', '--gateway-address', '10.20.193.97:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.97:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.a', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:28:59.682 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:28:59 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:28:59] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 76 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:28:59.683 INFO:tasks.nvmeof:[nvmeof] Nvmeof teardown completed! 2026-02-18T03:28:59.683 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-18T03:28:59.699 INFO:tasks.cephadm:Teardown begin 2026-02-18T03:28:59.699 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:28:59.726 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:28:59.752 DEBUG:teuthology.orchestra.run.trial097:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:28:59.776 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:28:59.800 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:28:59.826 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:28:59.866 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-18T03:28:59.867 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-18T03:28:59.984 INFO:teuthology.orchestra.run.trial097.stderr:Inferring config /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/mon.a/config 2026-02-18T03:29:00.003 INFO:teuthology.orchestra.run.trial097.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-18T03:29:00.020 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-18T03:29:00.021 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-18T03:29:00.021 DEBUG:teuthology.orchestra.run.trial031:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:29:00.039 DEBUG:teuthology.orchestra.run.trial078:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:29:00.058 DEBUG:teuthology.orchestra.run.trial097:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:29:00.072 DEBUG:teuthology.orchestra.run.trial114:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:29:00.085 DEBUG:teuthology.orchestra.run.trial119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:29:00.100 DEBUG:teuthology.orchestra.run.trial194:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:29:00.114 INFO:tasks.cephadm:Stopping all daemons... 2026-02-18T03:29:00.114 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-18T03:29:00.114 DEBUG:teuthology.orchestra.run.trial097:> sudo systemctl stop ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.a 2026-02-18T03:29:00.359 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:29:00 trial097 systemd[1]: Stopping Ceph mon.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:00.359 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:29:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a[21795]: 2026-02-18T03:29:00.210+0000 7fdefc10f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:29:00.359 INFO:journalctl@ceph.mon.a.trial097.stdout:Feb 18 03:29:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-a[21795]: 2026-02-18T03:29:00.210+0000 7fdefc10f640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-18T03:29:00.443 DEBUG:teuthology.orchestra.run.trial097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.a.service' 2026-02-18T03:29:00.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:00.479 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-18T03:29:00.479 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-18T03:29:00.480 DEBUG:teuthology.orchestra.run.trial114:> sudo systemctl stop ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.b 2026-02-18T03:29:00.658 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:00 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:00] WARNING state.py:1293 (2): Server is going down, stop updates 2026-02-18T03:29:00.750 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:29:00 trial114 systemd[1]: Stopping Ceph mon.b for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:00.750 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:29:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-b[23903]: 2026-02-18T03:29:00.575+0000 7fc4e7d56640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:29:00.750 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:29:00 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-b[23903]: 2026-02-18T03:29:00.575+0000 7fc4e7d56640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:29:00.750 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:29:00 trial114 podman[48404]: 2026-02-18 03:29:00.738173946 +0000 UTC m=+0.174343329 container died 8468313e987ea7471586a6ca9c972dd23995b53339e125f6c9d145278ef7021c (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-b, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.build-date=20260216, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-18T03:29:00.750 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:29:00 trial114 podman[48404]: 2026-02-18 03:29:00.746933198 +0000 UTC m=+0.183102581 container remove 8468313e987ea7471586a6ca9c972dd23995b53339e125f6c9d145278ef7021c (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-b, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, ceph=True, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:29:00.750 INFO:journalctl@ceph.mon.b.trial114.stdout:Feb 18 03:29:00 trial114 bash[48404]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-b 2026-02-18T03:29:00.815 DEBUG:teuthology.orchestra.run.trial114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.b.service' 2026-02-18T03:29:00.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:00.851 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-18T03:29:00.852 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-18T03:29:00.852 DEBUG:teuthology.orchestra.run.trial119:> sudo systemctl stop ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.c 2026-02-18T03:29:01.136 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:29:00 trial119 systemd[1]: Stopping Ceph mon.c for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:01.136 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:29:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-c[24138]: 2026-02-18T03:29:00.945+0000 7f7300f7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:29:01.136 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:29:00 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-c[24138]: 2026-02-18T03:29:00.945+0000 7f7300f7d640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:29:01.137 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:29:01 trial119 podman[48891]: 2026-02-18 03:29:01.047346731 +0000 UTC m=+0.113044424 container died 2d3aae9268a5b93235a62f07950bf88f026e84db68193ae2e0c37617c6efea89 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-c, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:29:01.137 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:29:01 trial119 podman[48891]: 2026-02-18 03:29:01.05646283 +0000 UTC m=+0.122160523 container remove 2d3aae9268a5b93235a62f07950bf88f026e84db68193ae2e0c37617c6efea89 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-c, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:29:01.137 INFO:journalctl@ceph.mon.c.trial119.stdout:Feb 18 03:29:01 trial119 bash[48891]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-mon-c 2026-02-18T03:29:01.141 DEBUG:teuthology.orchestra.run.trial119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mon.c.service' 2026-02-18T03:29:01.175 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:01.175 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-18T03:29:01.176 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-18T03:29:01.176 DEBUG:teuthology.orchestra.run.trial097:> sudo systemctl stop ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mgr.x 2026-02-18T03:29:01.406 DEBUG:teuthology.orchestra.run.trial097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@mgr.x.service' 2026-02-18T03:29:01.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:01.445 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-18T03:29:01.445 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-18T03:29:01.445 DEBUG:teuthology.orchestra.run.trial097:> sudo systemctl stop ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.0 2026-02-18T03:29:01.765 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:01 trial097 systemd[1]: Stopping Ceph osd.0 for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:01.766 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0[36099]: 2026-02-18T03:29:01.574+0000 7fabc91f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:29:01.766 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0[36099]: 2026-02-18T03:29:01.574+0000 7fabc91f9640 -1 osd.0 31 *** Got signal Terminated *** 2026-02-18T03:29:01.766 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0[36099]: 2026-02-18T03:29:01.574+0000 7fabc91f9640 -1 osd.0 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:29:01.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:01] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:29:01.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:01] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:29:01.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:01] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 81 2026-02-18T03:29:01.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:01] INFO state.py:1126 (81): Cleanup OMAP on exit (discovery-trial097) 2026-02-18T03:29:01.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:01] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:29:01.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:01] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:29:01.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:01] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:29:01.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a[48097]: [18-Feb-2026 03:29:01] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2026-02-18T03:29:01.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 podman[75112]: 2026-02-18 03:29:01.626624035 +0000 UTC m=+2.067338354 container died 94f13e3a26187a56734595cf88fbc6f6a6b77a3272dcdb80752764948b12f25e (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.build.pkgdep-args=--rbd, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, io.spdk.git.branch=undefined, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.version=9.0-30.el9, io.spdk.build.makeflags=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, release=, io.buildah.version=1.29.0, io.ceph.maintainer=Ceph Developers , io.spdk.version=25.09, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, name=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.target-arch=x86-64-v2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-type=git, io.ceph.git.branch=devel, io.openshift.wants=ceph,rbd, io.spdk.build.ceph-release=20.2.0, io.ceph.nvmeof=, summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, vendor=Red Hat, Inc., maintainer=Ceph Developers , io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, architecture=x86_64, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.version=1.6.5, url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8) 2026-02-18T03:29:01.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 podman[75112]: 2026-02-18 03:29:01.639290209 +0000 UTC m=+2.080004538 container remove 94f13e3a26187a56734595cf88fbc6f6a6b77a3272dcdb80752764948b12f25e (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a, version=1.6.5, architecture=x86_64, com.redhat.component=ubi9-container, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, name=ceph-nvmeof, vendor=Red Hat, Inc., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.pkgdep-args=--rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=undefined, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, url=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, org.centos.version=9.0-30.el9, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, build-date=2026-02-11 09:53:49 UTC, io.ceph.git.branch=devel, summary=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.openshift.wants=ceph,rbd, io.spdk.build.makeflags=, vcs-type=git, io.ceph.version=1.6.5, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.ceph-release=20.2.0, io.ceph.maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, release=, io.ceph.nvmeof=, io.buildah.version=1.29.0, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:29:01.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 bash[75112]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T03:29:01.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.a.service: Deactivated successfully. 2026-02-18T03:29:01.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:29:01.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial097.stdout:Feb 18 03:29:01 trial097 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 49min 38.353s CPU time, 1.5G memory peak. 2026-02-18T03:29:07.159 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:06 trial097 podman[75618]: 2026-02-18 03:29:06.897853015 +0000 UTC m=+5.335335675 container died f4a848f67b25f65a197082dfd182f68f679b5827dfe13bcde99cbb7e0a425f33 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, ceph=True) 2026-02-18T03:29:07.159 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:06 trial097 podman[75618]: 2026-02-18 03:29:06.906888922 +0000 UTC m=+5.344371572 container remove f4a848f67b25f65a197082dfd182f68f679b5827dfe13bcde99cbb7e0a425f33 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2026-02-18T03:29:07.159 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:06 trial097 bash[75618]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0 2026-02-18T03:29:07.160 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:07 trial097 podman[75842]: 2026-02-18 03:29:07.030016696 +0000 UTC m=+0.015901199 container create 8867e7da905580f52ca28d4f1b7f8e180b85a2bbe8881a23f17847d868f75c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, io.buildah.version=1.33.7, OSD_FLAVOR=debug) 2026-02-18T03:29:07.160 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:07 trial097 podman[75842]: 2026-02-18 03:29:07.061814104 +0000 UTC m=+0.047698607 container init 8867e7da905580f52ca28d4f1b7f8e180b85a2bbe8881a23f17847d868f75c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.vendor=CentOS, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-18T03:29:07.160 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:07 trial097 podman[75842]: 2026-02-18 03:29:07.064242872 +0000 UTC m=+0.050127375 container start 8867e7da905580f52ca28d4f1b7f8e180b85a2bbe8881a23f17847d868f75c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0-deactivate, io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:29:07.160 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:07 trial097 podman[75842]: 2026-02-18 03:29:07.064717421 +0000 UTC m=+0.050601944 container attach 8867e7da905580f52ca28d4f1b7f8e180b85a2bbe8881a23f17847d868f75c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-18T03:29:07.160 INFO:journalctl@ceph.osd.0.trial097.stdout:Feb 18 03:29:07 trial097 podman[75842]: 2026-02-18 03:29:07.023665345 +0000 UTC m=+0.009549868 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:29:07.228 DEBUG:teuthology.orchestra.run.trial097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.0.service' 2026-02-18T03:29:07.265 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:07.266 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-18T03:29:07.266 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-18T03:29:07.266 DEBUG:teuthology.orchestra.run.trial114:> sudo systemctl stop ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.1 2026-02-18T03:29:07.724 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:07 trial114 systemd[1]: Stopping Ceph osd.1 for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:07.724 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1[28801]: 2026-02-18T03:29:07.366+0000 7f51efc52640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:29:07.724 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1[28801]: 2026-02-18T03:29:07.366+0000 7f51efc52640 -1 osd.1 31 *** Got signal Terminated *** 2026-02-18T03:29:07.724 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:07 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1[28801]: 2026-02-18T03:29:07.366+0000 7f51efc52640 -1 osd.1 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:29:12.974 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:12 trial114 podman[48591]: 2026-02-18 03:29:12.680318847 +0000 UTC m=+5.325492094 container died 70a317e4252fd9e7df8eaf1bc69f7fc0c0e44ca7cd9428c49bb353d3028d465f (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, ceph=True, org.label-schema.build-date=20260216) 2026-02-18T03:29:12.974 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:12 trial114 podman[48591]: 2026-02-18 03:29:12.688358025 +0000 UTC m=+5.333531282 container remove 70a317e4252fd9e7df8eaf1bc69f7fc0c0e44ca7cd9428c49bb353d3028d465f (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-18T03:29:12.974 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:12 trial114 bash[48591]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1 2026-02-18T03:29:12.974 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:12 trial114 podman[48746]: 2026-02-18 03:29:12.817158917 +0000 UTC m=+0.018250475 container create 776f8c53a4814e6b5b2e728f10a32f7de01973e615fd636e73e7766172bc6c7b (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2026-02-18T03:29:12.974 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:12 trial114 podman[48746]: 2026-02-18 03:29:12.847938609 +0000 UTC m=+0.049030167 container init 776f8c53a4814e6b5b2e728f10a32f7de01973e615fd636e73e7766172bc6c7b (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.vendor=CentOS) 2026-02-18T03:29:12.974 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:12 trial114 podman[48746]: 2026-02-18 03:29:12.850773345 +0000 UTC m=+0.051864923 container start 776f8c53a4814e6b5b2e728f10a32f7de01973e615fd636e73e7766172bc6c7b (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1-deactivate, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed) 2026-02-18T03:29:12.974 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:12 trial114 podman[48746]: 2026-02-18 03:29:12.851289199 +0000 UTC m=+0.052380767 container attach 776f8c53a4814e6b5b2e728f10a32f7de01973e615fd636e73e7766172bc6c7b (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-18T03:29:12.974 INFO:journalctl@ceph.osd.1.trial114.stdout:Feb 18 03:29:12 trial114 podman[48746]: 2026-02-18 03:29:12.810385043 +0000 UTC m=+0.011476601 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:29:13.029 DEBUG:teuthology.orchestra.run.trial114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.1.service' 2026-02-18T03:29:13.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:13.062 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-18T03:29:13.062 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-18T03:29:13.062 DEBUG:teuthology.orchestra.run.trial119:> sudo systemctl stop ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.2 2026-02-18T03:29:13.464 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:13 trial119 systemd[1]: Stopping Ceph osd.2 for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:13.464 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2[29128]: 2026-02-18T03:29:13.154+0000 7f6ded075640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:29:13.464 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2[29128]: 2026-02-18T03:29:13.154+0000 7f6ded075640 -1 osd.2 31 *** Got signal Terminated *** 2026-02-18T03:29:13.464 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:13 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2[29128]: 2026-02-18T03:29:13.154+0000 7f6ded075640 -1 osd.2 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:29:18.875 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 podman[49103]: 2026-02-18 03:29:18.558204045 +0000 UTC m=+5.416687425 container died 9ab794098e5c47e868751f4e92a161077e940fc8bb401fac626225ea72f49e54 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-18T03:29:18.876 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 podman[49103]: 2026-02-18 03:29:18.567516675 +0000 UTC m=+5.426000055 container remove 9ab794098e5c47e868751f4e92a161077e940fc8bb401fac626225ea72f49e54 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, OSD_FLAVOR=debug, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:29:18.876 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 bash[49103]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2 2026-02-18T03:29:18.876 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 podman[49247]: 2026-02-18 03:29:18.696621016 +0000 UTC m=+0.015966724 container create 09d9ef13f7288d3ac79a876acfe27f81c4c1fd6092004adbc7a168f73167f8f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2-deactivate, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0) 2026-02-18T03:29:18.876 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 podman[49247]: 2026-02-18 03:29:18.737194208 +0000 UTC m=+0.056539917 container init 09d9ef13f7288d3ac79a876acfe27f81c4c1fd6092004adbc7a168f73167f8f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:29:18.876 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 podman[49247]: 2026-02-18 03:29:18.739650179 +0000 UTC m=+0.058995887 container start 09d9ef13f7288d3ac79a876acfe27f81c4c1fd6092004adbc7a168f73167f8f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-18T03:29:18.876 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 podman[49247]: 2026-02-18 03:29:18.740304667 +0000 UTC m=+0.059650375 container attach 09d9ef13f7288d3ac79a876acfe27f81c4c1fd6092004adbc7a168f73167f8f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-02-18T03:29:18.876 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 podman[49247]: 2026-02-18 03:29:18.690318297 +0000 UTC m=+0.009664005 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:29:18.877 INFO:journalctl@ceph.osd.2.trial119.stdout:Feb 18 03:29:18 trial119 podman[49247]: 2026-02-18 03:29:18.873309416 +0000 UTC m=+0.192655124 container died 09d9ef13f7288d3ac79a876acfe27f81c4c1fd6092004adbc7a168f73167f8f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216, OSD_FLAVOR=debug, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-02-18T03:29:18.908 DEBUG:teuthology.orchestra.run.trial119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.2.service' 2026-02-18T03:29:18.943 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:18.943 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-18T03:29:18.943 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-18T03:29:18.944 DEBUG:teuthology.orchestra.run.trial194:> sudo systemctl stop ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.3 2026-02-18T03:29:19.381 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:18 trial194 systemd[1]: Stopping Ceph osd.3 for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:19.381 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:19 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3[29004]: 2026-02-18T03:29:19.034+0000 7f2e04940640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:29:19.381 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:19 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3[29004]: 2026-02-18T03:29:19.034+0000 7f2e04940640 -1 osd.3 31 *** Got signal Terminated *** 2026-02-18T03:29:19.381 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:19 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3[29004]: 2026-02-18T03:29:19.034+0000 7f2e04940640 -1 osd.3 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:29:24.631 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:24 trial194 podman[49611]: 2026-02-18 03:29:24.366954667 +0000 UTC m=+5.345065562 container died a64ff55402753b17618b3aa1340d4ef5d11ca76133d6385b689b908d3132bff9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.build-date=20260216, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-02-18T03:29:24.632 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:24 trial194 podman[49611]: 2026-02-18 03:29:24.376831347 +0000 UTC m=+5.354942232 container remove a64ff55402753b17618b3aa1340d4ef5d11ca76133d6385b689b908d3132bff9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug) 2026-02-18T03:29:24.632 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:24 trial194 bash[49611]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3 2026-02-18T03:29:24.632 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:24 trial194 podman[49758]: 2026-02-18 03:29:24.513537605 +0000 UTC m=+0.017112339 container create 2ce07d1eab3f43b345bfdd26ebaa4f904d60934548b52e79d17bb51f5d210f1f (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2026-02-18T03:29:24.632 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:24 trial194 podman[49758]: 2026-02-18 03:29:24.543921498 +0000 UTC m=+0.047496211 container init 2ce07d1eab3f43b345bfdd26ebaa4f904d60934548b52e79d17bb51f5d210f1f (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-18T03:29:24.632 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:24 trial194 podman[49758]: 2026-02-18 03:29:24.546519601 +0000 UTC m=+0.050094314 container start 2ce07d1eab3f43b345bfdd26ebaa4f904d60934548b52e79d17bb51f5d210f1f (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-18T03:29:24.632 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:24 trial194 podman[49758]: 2026-02-18 03:29:24.54701905 +0000 UTC m=+0.050593783 container attach 2ce07d1eab3f43b345bfdd26ebaa4f904d60934548b52e79d17bb51f5d210f1f (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-18T03:29:24.632 INFO:journalctl@ceph.osd.3.trial194.stdout:Feb 18 03:29:24 trial194 podman[49758]: 2026-02-18 03:29:24.506368822 +0000 UTC m=+0.009943535 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:29:24.743 DEBUG:teuthology.orchestra.run.trial194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@osd.3.service' 2026-02-18T03:29:24.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:24.779 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-18T03:29:24.780 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force --keep-logs 2026-02-18T03:29:24.901 INFO:teuthology.orchestra.run.trial031.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:29:25.138 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force --keep-logs 2026-02-18T03:29:25.258 INFO:teuthology.orchestra.run.trial078.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:29:25.493 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force --keep-logs 2026-02-18T03:29:25.612 INFO:teuthology.orchestra.run.trial097.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:29:26.425 DEBUG:teuthology.orchestra.run.trial114:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force --keep-logs 2026-02-18T03:29:26.542 INFO:teuthology.orchestra.run.trial114.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:29:26.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:26 trial114 systemd[1]: Stopping Ceph nvmeof.nvmeof.b for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:26.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:29:26] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:29:26.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:29:26] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:29:26.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:29:26] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.b', '--gateway-address', '10.20.193.114:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.114:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.b', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:29:26.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:26 trial114 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b[33972]: [18-Feb-2026 03:29:26] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 139 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:29:37.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:36 trial114 bash[49022]: time="2026-02-18T03:29:36Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b in 10 seconds, resorting to SIGKILL" 2026-02-18T03:29:37.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:36 trial114 podman[49022]: 2026-02-18 03:29:36.942356266 +0000 UTC m=+10.034971993 container died 5cb12fb2318577711ea0f0218d4e9fd455c067db2f567ab3322d32fb29c67717 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.version=25.09, com.redhat.component=ubi9-container, io.spdk.build.pkgdep-args=--rbd, name=ceph-nvmeof, version=1.6.5, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.component=ceph-nvmeof, io.buildah.version=1.29.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , org.centos.version=9.0-30.el9, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, maintainer=Ceph Developers , io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.git.branch=undefined, io.ceph.version=1.6.5, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vendor=Red Hat, Inc., build-date=2026-02-11 09:53:49 UTC, distribution-scope=public, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.target-arch=x86-64-v2, architecture=x86_64, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.ceph-release=20.2.0, io.openshift.wants=ceph,rbd, vcs-type=git, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, release=, io.ceph.git.branch=devel, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.nvmeof=, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T03:29:37.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:36 trial114 podman[49022]: 2026-02-18 03:29:36.954229918 +0000 UTC m=+10.046845645 container remove 5cb12fb2318577711ea0f0218d4e9fd455c067db2f567ab3322d32fb29c67717 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.component=ceph-nvmeof, org.centos.version=9.0-30.el9, io.spdk.build.pkgdep-args=--rbd, name=ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , distribution-scope=public, io.spdk.build.makeflags=, io.openshift.wants=ceph,rbd, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, version=1.6.5, io.ceph.nvmeof=, com.redhat.component=ubi9-container, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, release=, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.git.branch=devel, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, io.spdk.build.target-arch=x86-64-v2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.buildah.version=1.29.0, io.spdk.version=25.09, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, build-date=2026-02-11 09:53:49 UTC, architecture=x86_64) 2026-02-18T03:29:37.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:36 trial114 bash[49022]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-b 2026-02-18T03:29:37.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:36 trial114 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.b.service: Main process exited, code=exited, status=137/n/a 2026-02-18T03:29:37.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:37 trial114 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.b.service: Failed with result 'exit-code'. 2026-02-18T03:29:37.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:37 trial114 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:29:37.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial114.stdout:Feb 18 03:29:37 trial114 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.b.service: Consumed 51min 35.263s CPU time. 2026-02-18T03:29:37.534 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force --keep-logs 2026-02-18T03:29:37.653 INFO:teuthology.orchestra.run.trial119.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:29:38.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:37 trial119 systemd[1]: Stopping Ceph nvmeof.nvmeof.c for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:38.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:29:38] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:29:38.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:29:38] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:29:38.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:29:38] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.c', '--gateway-address', '10.20.193.119:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.119:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.c', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:29:38.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:38 trial119 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c[34511]: [18-Feb-2026 03:29:38] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 94 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:29:48.367 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:48 trial119 bash[49538]: time="2026-02-18T03:29:48Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c in 10 seconds, resorting to SIGKILL" 2026-02-18T03:29:48.368 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:48 trial119 podman[49538]: 2026-02-18 03:29:48.042194238 +0000 UTC m=+10.031282912 container died 2bb9fda5181950e2e95cfca1a40a8129d3765c42b231f020df069768b0203e1d (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.build.target-arch=x86-64-v2, io.ceph.component=ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, build-date=2026-02-11 09:53:49 UTC, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, vcs-type=git, io.ceph.maintainer=Ceph Developers , maintainer=Ceph Developers , io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, architecture=x86_64, io.ceph.git.branch=devel, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.version=1.6.5, vendor=Red Hat, Inc., io.spdk.build.makeflags=, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, summary=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.nvmeof=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.ceph-release=20.2.0, name=ceph-nvmeof, io.spdk.git.branch=undefined, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, version=1.6.5, url=https://github.com/ceph/ceph-nvmeof, io.buildah.version=1.29.0, release=, io.spdk.build.pkgdep-args=--rbd, io.openshift.wants=ceph,rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug) 2026-02-18T03:29:48.368 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:48 trial119 podman[49538]: 2026-02-18 03:29:48.05362022 +0000 UTC m=+10.042708895 container remove 2bb9fda5181950e2e95cfca1a40a8129d3765c42b231f020df069768b0203e1d (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.nvmeof=, io.ceph.version=1.6.5, vcs-type=git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.spdk.build.pkgdep-args=--rbd, version=1.6.5, url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, io.spdk.git.branch=undefined, summary=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, architecture=x86_64, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.makeflags=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.target-arch=x86-64-v2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , name=ceph-nvmeof, vendor=Red Hat, Inc., io.spdk.git.repo=https://github.com/ceph/spdk.git, io.buildah.version=1.29.0, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, release=, build-date=2026-02-11 09:53:49 UTC, com.redhat.component=ubi9-container, maintainer=Ceph Developers , io.ceph.git.branch=devel) 2026-02-18T03:29:48.368 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:48 trial119 bash[49538]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-c 2026-02-18T03:29:48.368 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:48 trial119 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.c.service: Main process exited, code=exited, status=137/n/a 2026-02-18T03:29:48.368 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:48 trial119 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.c.service: Failed with result 'exit-code'. 2026-02-18T03:29:48.368 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:48 trial119 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:29:48.368 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial119.stdout:Feb 18 03:29:48 trial119 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.c.service: Consumed 52min 12.764s CPU time. 2026-02-18T03:29:48.630 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force --keep-logs 2026-02-18T03:29:48.752 INFO:teuthology.orchestra.run.trial194.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:29:49.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:48 trial194 systemd[1]: Stopping Ceph nvmeof.nvmeof.d for eb431a19-0c77-11f1-b2a8-d404e6e7d460... 2026-02-18T03:29:49.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:29:49] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:29:49.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:29:49] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:29:49.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:29:49] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.d', '--gateway-address', '10.20.193.194:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.194:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.d', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:29:49.381 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:49 trial194 ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d[35183]: [18-Feb-2026 03:29:49] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 118 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:29:59.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:59 trial194 bash[50025]: time="2026-02-18T03:29:59Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d in 10 seconds, resorting to SIGKILL" 2026-02-18T03:29:59.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:59 trial194 podman[50025]: 2026-02-18 03:29:59.026428806 +0000 UTC m=+10.035130570 container died 2559778aa6b444047a7d6119aba21fae98081a7757f4b3bb082e157bc55aa954 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.version=1.6.5, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc., io.spdk.build.pkgdep-args=--rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, name=ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, version=1.6.5, io.spdk.git.branch=undefined, io.ceph.maintainer=Ceph Developers , io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, maintainer=Ceph Developers , io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, build-date=2026-02-11 09:53:49 UTC, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.version=25.09, io.ceph.git.branch=devel, vcs-type=git, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.component=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, distribution-scope=public, architecture=x86_64, summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.wants=ceph,rbd, io.spdk.build.ceph-release=20.2.0, io.ceph.nvmeof=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, release=) 2026-02-18T03:29:59.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:59 trial194 podman[50025]: 2026-02-18 03:29:59.037479991 +0000 UTC m=+10.046181745 container remove 2559778aa6b444047a7d6119aba21fae98081a7757f4b3bb082e157bc55aa954 (image=quay.io/ceph/nvmeof:devel, name=ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.component=ubi9-container, io.openshift.wants=ceph,rbd, name=ceph-nvmeof, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.spdk.build.ceph-release=20.2.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vendor=Red Hat, Inc., io.ceph.nvmeof=, maintainer=Ceph Developers , io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.git.branch=devel, io.ceph.version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.pkgdep-args=--rbd, summary=Ceph NVMe over Fabrics Gateway, vcs-type=git, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.branch=undefined, org.centos.version=9.0-30.el9, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.target-arch=x86-64-v2, version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., release=, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.maintainer=Ceph Developers , io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T03:29:59.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:59 trial194 bash[50025]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460-nvmeof-nvmeof-d 2026-02-18T03:29:59.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:59 trial194 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.d.service: Main process exited, code=exited, status=137/n/a 2026-02-18T03:29:59.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:59 trial194 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.d.service: Failed with result 'exit-code'. 2026-02-18T03:29:59.376 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:59 trial194 systemd[1]: Stopped Ceph nvmeof.nvmeof.d for eb431a19-0c77-11f1-b2a8-d404e6e7d460. 2026-02-18T03:29:59.376 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial194.stdout:Feb 18 03:29:59 trial194 systemd[1]: ceph-eb431a19-0c77-11f1-b2a8-d404e6e7d460@nvmeof.nvmeof.d.service: Consumed 52min 49.440s CPU time. 2026-02-18T03:29:59.633 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:29:59.662 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:29:59.691 DEBUG:teuthology.orchestra.run.trial097:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:29:59.719 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:29:59.748 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:29:59.777 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:29:59.807 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-18T03:29:59.810 DEBUG:teuthology.misc:Transferring archived files from trial031:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial031/crash 2026-02-18T03:29:59.811 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash -- . 2026-02-18T03:29:59.837 INFO:teuthology.orchestra.run.trial031.stderr:tar: /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T03:29:59.838 INFO:teuthology.orchestra.run.trial031.stderr:tar: Error is not recoverable: exiting now 2026-02-18T03:29:59.840 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial078/crash 2026-02-18T03:29:59.841 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash -- . 2026-02-18T03:29:59.867 INFO:teuthology.orchestra.run.trial078.stderr:tar: /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T03:29:59.867 INFO:teuthology.orchestra.run.trial078.stderr:tar: Error is not recoverable: exiting now 2026-02-18T03:29:59.869 DEBUG:teuthology.misc:Transferring archived files from trial097:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial097/crash 2026-02-18T03:29:59.870 DEBUG:teuthology.orchestra.run.trial097:> sudo tar c -f - -C /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash -- . 2026-02-18T03:29:59.896 INFO:teuthology.orchestra.run.trial097.stderr:tar: /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T03:29:59.897 INFO:teuthology.orchestra.run.trial097.stderr:tar: Error is not recoverable: exiting now 2026-02-18T03:29:59.899 DEBUG:teuthology.misc:Transferring archived files from trial114:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial114/crash 2026-02-18T03:29:59.900 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash -- . 2026-02-18T03:29:59.926 INFO:teuthology.orchestra.run.trial114.stderr:tar: /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T03:29:59.927 INFO:teuthology.orchestra.run.trial114.stderr:tar: Error is not recoverable: exiting now 2026-02-18T03:29:59.928 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial119/crash 2026-02-18T03:29:59.929 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash -- . 2026-02-18T03:29:59.955 INFO:teuthology.orchestra.run.trial119.stderr:tar: /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T03:29:59.955 INFO:teuthology.orchestra.run.trial119.stderr:tar: Error is not recoverable: exiting now 2026-02-18T03:29:59.957 DEBUG:teuthology.misc:Transferring archived files from trial194:/var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial194/crash 2026-02-18T03:29:59.957 DEBUG:teuthology.orchestra.run.trial194:> sudo tar c -f - -C /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash -- . 2026-02-18T03:29:59.983 INFO:teuthology.orchestra.run.trial194.stderr:tar: /var/lib/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T03:29:59.983 INFO:teuthology.orchestra.run.trial194.stderr:tar: Error is not recoverable: exiting now 2026-02-18T03:29:59.984 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-18T03:29:59.985 DEBUG:teuthology.orchestra.run.trial097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v OSD_DOWN | egrep -v OSD_HOST_DOWN | egrep -v OSD_ROOT_DOWN | egrep -v PG_DEGRADED | egrep -v NVMEOF_SINGLE_GATEWAY | egrep -v CEPHADM_FAILED_DAEMON | head -n 1 2026-02-18T03:30:00.011 INFO:tasks.cephadm:Compressing logs... 2026-02-18T03:30:00.011 DEBUG:teuthology.orchestra.run.trial031:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:30:00.012 DEBUG:teuthology.orchestra.run.trial078:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:30:00.014 DEBUG:teuthology.orchestra.run.trial097:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:30:00.035 INFO:teuthology.orchestra.run.trial031.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-18T03:30:00.037 INFO:teuthology.orchestra.run.trial078.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-18T03:30:00.044 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T03:30:00.045 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log 2026-02-18T03:30:00.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/cephadm.log: 81.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T03:30:00.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log: 83.0% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log.gz 2026-02-18T03:30:00.048 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-18T03:30:00.048 INFO:teuthology.orchestra.run.trial078.stderr:real 0m0.018s 2026-02-18T03:30:00.048 INFO:teuthology.orchestra.run.trial078.stderr:user 0m0.008s 2026-02-18T03:30:00.048 INFO:teuthology.orchestra.run.trial078.stderr:sys 0m0.012s 2026-02-18T03:30:00.053 DEBUG:teuthology.orchestra.run.trial114:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:30:00.055 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T03:30:00.056 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log 2026-02-18T03:30:00.056 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/cephadm.log: 81.6% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T03:30:00.056 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log: 82.9% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log.gz 2026-02-18T03:30:00.057 DEBUG:teuthology.orchestra.run.trial119:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:30:00.059 INFO:teuthology.orchestra.run.trial031.stderr: 2026-02-18T03:30:00.059 INFO:teuthology.orchestra.run.trial031.stderr:real 0m0.030s 2026-02-18T03:30:00.059 INFO:teuthology.orchestra.run.trial031.stderr:user 0m0.008s 2026-02-18T03:30:00.059 INFO:teuthology.orchestra.run.trial031.stderr:sys 0m0.011s 2026-02-18T03:30:00.060 DEBUG:teuthology.orchestra.run.trial194:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:30:00.076 INFO:teuthology.orchestra.run.trial097.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T03:30:00.076 INFO:teuthology.orchestra.run.trial097.stderr:: No such file or directory 2026-02-18T03:30:00.076 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.a.log 2026-02-18T03:30:00.076 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.0.log 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.a.log: /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log: 83.4% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log.gz 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mgr.x.log 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log: /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mgr.x.log: 89.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log: 90.1% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log.gz 2026-02-18T03:30:00.079 INFO:teuthology.orchestra.run.trial097.stderr: 87.4% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log.gz 2026-02-18T03:30:00.080 INFO:teuthology.orchestra.run.trial114.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-18T03:30:00.080 INFO:teuthology.orchestra.run.trial097.stderr: 95.6% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log.gz 2026-02-18T03:30:00.082 INFO:teuthology.orchestra.run.trial119.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/cephadm.log 2026-02-18T03:30:00.082 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-18T03:30:00.082 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.2.log 2026-02-18T03:30:00.082 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.c.log 2026-02-18T03:30:00.083 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log 2026-02-18T03:30:00.083 INFO:teuthology.orchestra.run.trial119.stderr: 88.5% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T03:30:00.083 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log 2026-02-18T03:30:00.083 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log 2026-02-18T03:30:00.084 INFO:teuthology.orchestra.run.trial119.stderr: 83.0% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log.gz 2026-02-18T03:30:00.084 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log 2026-02-18T03:30:00.084 INFO:teuthology.orchestra.run.trial194.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-18T03:30:00.084 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T03:30:00.084 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.3.log 2026-02-18T03:30:00.084 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log 2026-02-18T03:30:00.085 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log: /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log: 87.5% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log.gz 2026-02-18T03:30:00.085 INFO:teuthology.orchestra.run.trial119.stderr: 90.2% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log.gz 2026-02-18T03:30:00.085 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.3.log: /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log: 88.1% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T03:30:00.087 INFO:teuthology.orchestra.run.trial119.stderr: 95.5% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log.gz 2026-02-18T03:30:00.087 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T03:30:00.088 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log 2026-02-18T03:30:00.088 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log 2026-02-18T03:30:00.088 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.b.log 2026-02-18T03:30:00.088 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log 2026-02-18T03:30:00.088 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log: 83.0% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.cephadm.log.gz 2026-02-18T03:30:00.089 INFO:teuthology.orchestra.run.trial114.stderr: 88.1% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T03:30:00.089 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.1.log 2026-02-18T03:30:00.089 INFO:teuthology.orchestra.run.trial194.stderr: 95.5% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log.gz 2026-02-18T03:30:00.089 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log 2026-02-18T03:30:00.090 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.1.log: /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log: 90.2% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.audit.log.gz 2026-02-18T03:30:00.091 INFO:teuthology.orchestra.run.trial114.stderr: 87.5% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph.log.gz 2026-02-18T03:30:00.092 INFO:teuthology.orchestra.run.trial114.stderr: 95.5% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-volume.log.gz 2026-02-18T03:30:00.302 INFO:teuthology.orchestra.run.trial119.stderr: 93.0% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.c.log.gz 2026-02-18T03:30:00.306 INFO:teuthology.orchestra.run.trial114.stderr: 93.2% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.b.log.gz 2026-02-18T03:30:00.311 INFO:teuthology.orchestra.run.trial097.stderr: 90.9% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-18T03:30:00.572 INFO:teuthology.orchestra.run.trial097.stderr: 91.5% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-mon.a.log.gz 2026-02-18T03:32:12.393 INFO:teuthology.orchestra.run.trial114.stderr: 92.5% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.1.log.gz 2026-02-18T03:32:12.395 INFO:teuthology.orchestra.run.trial114.stderr: 2026-02-18T03:32:12.395 INFO:teuthology.orchestra.run.trial114.stderr:real 2m12.324s 2026-02-18T03:32:12.396 INFO:teuthology.orchestra.run.trial114.stderr:user 2m7.248s 2026-02-18T03:32:12.396 INFO:teuthology.orchestra.run.trial114.stderr:sys 0m4.972s 2026-02-18T03:32:16.427 INFO:teuthology.orchestra.run.trial097.stderr: 92.4% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.0.log.gz 2026-02-18T03:32:16.429 INFO:teuthology.orchestra.run.trial097.stderr: 2026-02-18T03:32:16.429 INFO:teuthology.orchestra.run.trial097.stderr:real 2m16.363s 2026-02-18T03:32:16.429 INFO:teuthology.orchestra.run.trial097.stderr:user 2m11.701s 2026-02-18T03:32:16.429 INFO:teuthology.orchestra.run.trial097.stderr:sys 0m5.071s 2026-02-18T03:32:37.249 INFO:teuthology.orchestra.run.trial194.stderr: 92.6% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.3.log.gz 2026-02-18T03:32:37.252 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-18T03:32:37.252 INFO:teuthology.orchestra.run.trial194.stderr:real 2m37.176s 2026-02-18T03:32:37.252 INFO:teuthology.orchestra.run.trial194.stderr:user 2m30.984s 2026-02-18T03:32:37.252 INFO:teuthology.orchestra.run.trial194.stderr:sys 0m5.833s 2026-02-18T03:32:46.447 INFO:teuthology.orchestra.run.trial119.stderr: 92.4% -- replaced with /var/log/ceph/eb431a19-0c77-11f1-b2a8-d404e6e7d460/ceph-osd.2.log.gz 2026-02-18T03:32:46.449 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-18T03:32:46.450 INFO:teuthology.orchestra.run.trial119.stderr:real 2m46.376s 2026-02-18T03:32:46.450 INFO:teuthology.orchestra.run.trial119.stderr:user 2m39.947s 2026-02-18T03:32:46.450 INFO:teuthology.orchestra.run.trial119.stderr:sys 0m6.254s 2026-02-18T03:32:46.450 INFO:tasks.cephadm:Archiving logs... 2026-02-18T03:32:46.452 DEBUG:teuthology.misc:Transferring archived files from trial031:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial031/log 2026-02-18T03:32:46.453 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T03:32:46.495 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial078/log 2026-02-18T03:32:46.496 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T03:32:46.539 DEBUG:teuthology.misc:Transferring archived files from trial097:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial097/log 2026-02-18T03:32:46.540 DEBUG:teuthology.orchestra.run.trial097:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T03:32:57.354 DEBUG:teuthology.misc:Transferring archived files from trial114:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial114/log 2026-02-18T03:32:57.355 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T03:33:07.783 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial119/log 2026-02-18T03:33:07.784 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T03:33:21.087 DEBUG:teuthology.misc:Transferring archived files from trial194:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial194/log 2026-02-18T03:33:21.088 DEBUG:teuthology.orchestra.run.trial194:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T03:33:33.512 INFO:tasks.cephadm:Removing cluster... 2026-02-18T03:33:33.512 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force 2026-02-18T03:33:33.630 INFO:teuthology.orchestra.run.trial031.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:33:33.865 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force 2026-02-18T03:33:33.985 INFO:teuthology.orchestra.run.trial078.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:33:34.217 DEBUG:teuthology.orchestra.run.trial097:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force 2026-02-18T03:33:34.338 INFO:teuthology.orchestra.run.trial097.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:33:34.752 DEBUG:teuthology.orchestra.run.trial114:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force 2026-02-18T03:33:34.872 INFO:teuthology.orchestra.run.trial114.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:33:35.266 DEBUG:teuthology.orchestra.run.trial119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force 2026-02-18T03:33:35.387 INFO:teuthology.orchestra.run.trial119.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:33:35.848 DEBUG:teuthology.orchestra.run.trial194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eb431a19-0c77-11f1-b2a8-d404e6e7d460 --force 2026-02-18T03:33:35.968 INFO:teuthology.orchestra.run.trial194.stdout:Deleting cluster with fsid: eb431a19-0c77-11f1-b2a8-d404e6e7d460 2026-02-18T03:33:36.394 INFO:tasks.cephadm:Removing cephadm ... 2026-02-18T03:33:36.395 DEBUG:teuthology.orchestra.run.trial031:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T03:33:36.414 DEBUG:teuthology.orchestra.run.trial078:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T03:33:36.434 DEBUG:teuthology.orchestra.run.trial097:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T03:33:36.453 DEBUG:teuthology.orchestra.run.trial114:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T03:33:36.472 DEBUG:teuthology.orchestra.run.trial119:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T03:33:36.491 DEBUG:teuthology.orchestra.run.trial194:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T03:33:36.509 INFO:tasks.cephadm:Teardown complete 2026-02-18T03:33:36.509 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-18T03:33:36.520 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-18T03:33:36.521 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T03:33:36.523 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T03:33:36.526 DEBUG:teuthology.orchestra.run.trial097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T03:33:36.529 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T03:33:36.531 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T03:33:36.534 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T03:33:37.019 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-18T03:33:37.030 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-18T03:33:37.030 DEBUG:teuthology.orchestra.run.trial031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:33:37.032 DEBUG:teuthology.orchestra.run.trial078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:33:37.034 DEBUG:teuthology.orchestra.run.trial097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:33:37.035 DEBUG:teuthology.orchestra.run.trial114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:33:37.037 DEBUG:teuthology.orchestra.run.trial119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:33:37.039 DEBUG:teuthology.orchestra.run.trial194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:33:37.047 INFO:teuthology.orchestra.run.trial031.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:33:37.048 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:33:37.050 INFO:teuthology.orchestra.run.trial097.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:33:37.052 INFO:teuthology.orchestra.run.trial114.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:33:37.053 INFO:teuthology.orchestra.run.trial119.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:33:37.055 INFO:teuthology.orchestra.run.trial194.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial078.stdout:^- 172-235-154-118.ip.linod> 4 7 377 6 -4795us[-4795us] +/- 59ms 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial078.stdout:^- wdc1.us.ntp.li 3 7 377 72 -1684us[-1782us] +/- 30ms 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial078.stdout:^- ntp1.glypnod.com 2 6 377 8 -1217us[-1217us] +/- 42ms 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial078.stdout:^* pool-96-231-54-150.washd> 1 7 51 69 -185us[ -284us] +/- 6595us 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial119.stdout:=============================================================================== 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial119.stdout:^* 50.205.57.38 1 7 377 10 -267us[ -418us] +/- 4770us 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial119.stdout:^- 69-10-208-170.rainiercon> 2 6 377 9 -1626us[-1626us] +/- 61ms 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial119.stdout:^- 155.248.196.28 2 7 377 6 -690us[ -690us] +/- 49ms 2026-02-18T03:33:37.080 INFO:teuthology.orchestra.run.trial119.stdout:^- 66.42.71.197.vultruserco> 3 7 377 138 -1770us[-2230us] +/- 45ms 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial031.stdout:=============================================================================== 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial031.stdout:^+ 23.186.168.131 2 7 377 71 +1415us[+1505us] +/- 56ms 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial031.stdout:^+ 69-10-208-170.rainiercon> 2 6 377 7 -561us[ -436us] +/- 61ms 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial031.stdout:^* 155.248.196.28 2 7 377 7 +346us[ +471us] +/- 49ms 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial031.stdout:^+ 66.42.71.197.vultruserco> 3 7 377 9 -673us[ -548us] +/- 45ms 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial194.stdout:=============================================================================== 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial194.stdout:^- 172-235-154-118.ip.linod> 4 7 377 72 -4099us[-4154us] +/- 60ms 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial194.stdout:^- wdc1.us.ntp.li 3 7 377 74 -1114us[-1169us] +/- 30ms 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial194.stdout:^- ntp1.glypnod.com 2 6 377 5 -873us[ -873us] +/- 42ms 2026-02-18T03:33:37.081 INFO:teuthology.orchestra.run.trial194.stdout:^* pool-96-231-54-150.washd> 1 7 341 68 -61us[ -117us] +/- 5896us 2026-02-18T03:33:37.086 INFO:teuthology.orchestra.run.trial097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:33:37.086 INFO:teuthology.orchestra.run.trial097.stdout:=============================================================================== 2026-02-18T03:33:37.086 INFO:teuthology.orchestra.run.trial097.stdout:^+ connected.by.freedominte> 2 6 377 7 -369us[ -369us] +/- 41ms 2026-02-18T03:33:37.086 INFO:teuthology.orchestra.run.trial097.stdout:^* 108.61.73.244 2 6 377 7 +57us[ +369us] +/- 22ms 2026-02-18T03:33:37.086 INFO:teuthology.orchestra.run.trial097.stdout:^- 172-232-15-202.ip.linode> 2 6 377 7 -6803us[-6803us] +/- 76ms 2026-02-18T03:33:37.086 INFO:teuthology.orchestra.run.trial097.stdout:^- time-he.den.codehof.net 2 6 377 6 +16ms[ +16ms] +/- 39ms 2026-02-18T03:33:37.091 INFO:teuthology.orchestra.run.trial114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:33:37.091 INFO:teuthology.orchestra.run.trial114.stdout:=============================================================================== 2026-02-18T03:33:37.091 INFO:teuthology.orchestra.run.trial114.stdout:^- 23.186.168.131 2 6 377 7 +889us[ +889us] +/- 56ms 2026-02-18T03:33:37.091 INFO:teuthology.orchestra.run.trial114.stdout:^* nyc2.us.ntp.li 2 7 377 73 -72us[ -63us] +/- 2964us 2026-02-18T03:33:37.091 INFO:teuthology.orchestra.run.trial114.stdout:^- ntp.sfo.icanbwell.com 2 7 377 7 -1336us[-1336us] +/- 39ms 2026-02-18T03:33:37.091 INFO:teuthology.orchestra.run.trial114.stdout:^- 69.9.131.124 2 6 377 4 +7812us[+7812us] +/- 77ms 2026-02-18T03:33:37.092 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-18T03:33:37.103 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-18T03:33:37.104 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-18T03:33:37.120 DEBUG:teuthology.orchestra.run.trial031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T03:33:37.175 DEBUG:teuthology.orchestra.run.trial078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T03:33:37.219 DEBUG:teuthology.orchestra.run.trial097:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T03:33:37.267 DEBUG:teuthology.orchestra.run.trial114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T03:33:37.311 DEBUG:teuthology.orchestra.run.trial119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T03:33:37.356 DEBUG:teuthology.orchestra.run.trial194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T03:33:37.400 DEBUG:teuthology.orchestra.run.trial031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:33:37.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:37.427 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:33:37.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:37.452 DEBUG:teuthology.orchestra.run.trial097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:33:37.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:37.478 DEBUG:teuthology.orchestra.run.trial114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:33:37.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:37.503 DEBUG:teuthology.orchestra.run.trial119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:33:37.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:37.529 DEBUG:teuthology.orchestra.run.trial194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:33:37.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:37.555 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-18T03:33:37.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-18T03:33:37.581 INFO:teuthology.task.internal:Duration was 1350.012642 seconds 2026-02-18T03:33:37.581 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-18T03:33:37.596 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-18T03:33:37.596 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T03:33:37.598 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T03:33:37.599 DEBUG:teuthology.orchestra.run.trial097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T03:33:37.601 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T03:33:37.603 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T03:33:37.604 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T03:33:37.633 INFO:teuthology.orchestra.run.trial031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:33:37.633 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:33:37.636 INFO:teuthology.orchestra.run.trial097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:33:37.637 INFO:teuthology.orchestra.run.trial114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:33:37.638 INFO:teuthology.orchestra.run.trial119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:33:37.639 INFO:teuthology.orchestra.run.trial194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:33:38.161 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-18T03:33:38.161 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial031.front.sepia.ceph.com 2026-02-18T03:33:38.162 DEBUG:teuthology.orchestra.run.trial031:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T03:33:38.181 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial078.front.sepia.ceph.com 2026-02-18T03:33:38.181 DEBUG:teuthology.orchestra.run.trial078:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T03:33:38.200 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial097.front.sepia.ceph.com 2026-02-18T03:33:38.200 DEBUG:teuthology.orchestra.run.trial097:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T03:33:38.219 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial114.front.sepia.ceph.com 2026-02-18T03:33:38.219 DEBUG:teuthology.orchestra.run.trial114:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T03:33:38.237 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial119.front.sepia.ceph.com 2026-02-18T03:33:38.237 DEBUG:teuthology.orchestra.run.trial119:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T03:33:38.256 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial194.front.sepia.ceph.com 2026-02-18T03:33:38.256 DEBUG:teuthology.orchestra.run.trial194:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T03:33:38.275 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-18T03:33:38.275 DEBUG:teuthology.orchestra.run.trial031:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.277 DEBUG:teuthology.orchestra.run.trial078:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.279 DEBUG:teuthology.orchestra.run.trial097:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.280 DEBUG:teuthology.orchestra.run.trial114:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.281 DEBUG:teuthology.orchestra.run.trial119:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.297 DEBUG:teuthology.orchestra.run.trial194:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.380 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-18T03:33:38.380 DEBUG:teuthology.orchestra.run.trial031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:33:38.381 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:33:38.383 DEBUG:teuthology.orchestra.run.trial097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:33:38.384 DEBUG:teuthology.orchestra.run.trial114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:33:38.386 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:33:38.387 DEBUG:teuthology.orchestra.run.trial194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T03:33:38.403 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:33:38.403 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:33:38.403 INFO:teuthology.orchestra.run.trial031.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T03:33:38.403 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.404 INFO:teuthology.orchestra.run.trial031.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/journalctl.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T03:33:38.405 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:33:38.405 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:33:38.406 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:33:38.406 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T03:33:38.406 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:33:38.406 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.406 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T03:33:38.406 INFO:teuthology.orchestra.run.trial097.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.406 INFO:teuthology.orchestra.run.trial097.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T03:33:38.407 INFO:teuthology.orchestra.run.trial097.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T03:33:38.407 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:33:38.407 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:33:38.407 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T03:33:38.407 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.408 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:33:38.408 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T03:33:38.408 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:33:38.408 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T03:33:38.408 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.408 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T03:33:38.410 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:33:38.410 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:33:38.411 INFO:teuthology.orchestra.run.trial194.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T03:33:38.411 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T03:33:38.411 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T03:33:38.411 INFO:teuthology.orchestra.run.trial194.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T03:33:38.414 INFO:teuthology.orchestra.run.trial031.stderr: 91.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T03:33:38.418 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T03:33:38.418 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T03:33:38.419 INFO:teuthology.orchestra.run.trial194.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T03:33:38.422 INFO:teuthology.orchestra.run.trial097.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T03:33:38.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-18T03:33:38.436 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-18T03:33:38.437 DEBUG:teuthology.orchestra.run.trial031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T03:33:38.480 DEBUG:teuthology.orchestra.run.trial078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T03:33:38.506 DEBUG:teuthology.orchestra.run.trial097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T03:33:38.531 DEBUG:teuthology.orchestra.run.trial114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T03:33:38.557 DEBUG:teuthology.orchestra.run.trial119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T03:33:38.583 DEBUG:teuthology.orchestra.run.trial194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T03:33:38.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-18T03:33:38.620 DEBUG:teuthology.orchestra.run.trial031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.622 DEBUG:teuthology.orchestra.run.trial078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.624 DEBUG:teuthology.orchestra.run.trial097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.625 DEBUG:teuthology.orchestra.run.trial114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.627 DEBUG:teuthology.orchestra.run.trial119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.628 DEBUG:teuthology.orchestra.run.trial194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.644 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern = core 2026-02-18T03:33:38.646 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = core 2026-02-18T03:33:38.648 INFO:teuthology.orchestra.run.trial097.stdout:kernel.core_pattern = core 2026-02-18T03:33:38.649 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = core 2026-02-18T03:33:38.650 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern = core 2026-02-18T03:33:38.672 INFO:teuthology.orchestra.run.trial194.stdout:kernel.core_pattern = core 2026-02-18T03:33:38.683 DEBUG:teuthology.orchestra.run.trial031:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:38.717 DEBUG:teuthology.orchestra.run.trial078:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:38.734 DEBUG:teuthology.orchestra.run.trial097:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:38.751 DEBUG:teuthology.orchestra.run.trial114:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:38.769 DEBUG:teuthology.orchestra.run.trial119:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:38.786 DEBUG:teuthology.orchestra.run.trial194:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T03:33:38.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:33:38.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-18T03:33:38.816 INFO:teuthology.task.internal:Transferring archived files... 2026-02-18T03:33:38.816 DEBUG:teuthology.misc:Transferring archived files from trial031:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial031 2026-02-18T03:33:38.816 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T03:33:38.847 DEBUG:teuthology.misc:Transferring archived files from trial078:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial078 2026-02-18T03:33:38.847 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T03:33:38.877 DEBUG:teuthology.misc:Transferring archived files from trial097:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial097 2026-02-18T03:33:38.877 DEBUG:teuthology.orchestra.run.trial097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T03:33:38.908 DEBUG:teuthology.misc:Transferring archived files from trial114:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial114 2026-02-18T03:33:38.908 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T03:33:38.942 DEBUG:teuthology.misc:Transferring archived files from trial119:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial119 2026-02-18T03:33:38.943 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T03:33:38.977 DEBUG:teuthology.misc:Transferring archived files from trial194:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54509/remote/trial194 2026-02-18T03:33:38.978 DEBUG:teuthology.orchestra.run.trial194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T03:33:39.011 INFO:teuthology.task.internal:Removing archive directory... 2026-02-18T03:33:39.012 DEBUG:teuthology.orchestra.run.trial031:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T03:33:39.014 DEBUG:teuthology.orchestra.run.trial078:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T03:33:39.018 DEBUG:teuthology.orchestra.run.trial097:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T03:33:39.020 DEBUG:teuthology.orchestra.run.trial114:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T03:33:39.024 DEBUG:teuthology.orchestra.run.trial119:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T03:33:39.026 DEBUG:teuthology.orchestra.run.trial194:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T03:33:39.062 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-18T03:33:39.084 INFO:teuthology.task.internal:Not uploading archives. 2026-02-18T03:33:39.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-18T03:33:39.102 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-18T03:33:39.102 DEBUG:teuthology.orchestra.run.trial031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T03:33:39.104 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T03:33:39.107 DEBUG:teuthology.orchestra.run.trial097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T03:33:39.110 DEBUG:teuthology.orchestra.run.trial114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T03:33:39.113 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T03:33:39.116 DEBUG:teuthology.orchestra.run.trial194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T03:33:39.118 INFO:teuthology.orchestra.run.trial031.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 03:33 /home/ubuntu/cephtest 2026-02-18T03:33:39.123 INFO:teuthology.orchestra.run.trial078.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 03:33 /home/ubuntu/cephtest 2026-02-18T03:33:39.125 INFO:teuthology.orchestra.run.trial097.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 03:33 /home/ubuntu/cephtest 2026-02-18T03:33:39.127 INFO:teuthology.orchestra.run.trial114.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 03:33 /home/ubuntu/cephtest 2026-02-18T03:33:39.131 INFO:teuthology.orchestra.run.trial119.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 03:33 /home/ubuntu/cephtest 2026-02-18T03:33:39.132 INFO:teuthology.orchestra.run.trial194.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 03:33 /home/ubuntu/cephtest 2026-02-18T03:33:39.133 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-18T03:33:39.151 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-18T03:33:39.190 INFO:teuthology.run:Summary data: description: nvmeof/basic/{base/install centos_latest clusters/4-gateways-2-initiator conf/{disable-pool-app} workloads/nvmeof_initiator} duration: 1350.0126421451569 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-18T03:33:39.190 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T03:33:39.401 INFO:teuthology.run:pass